vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #175
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 13)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.t1ZaSy1gaL', fmt=raw size=107374182412gitlab # mke2fs 1.47.3 (8-Jul-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: ab50475c-f24a-450e-b692-5d166586237a16(finished: start all VMs, in 69.50 seconds)17gitlab # Superblock backups stored on blocks:18gitlab: waiting for unit setup-gitlab.service19gitlab # 32768, 98304, 163840, 22937620gitlab: waiting for the VM to finish booting21gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Jun 1 15:51:08 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s185944 r8192 d117160 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/7c6izzib9bj71bg1bazr77mdx3xfmnr4-nixos-system-gitlab-test/init regInfo=/nix/store/5nqsmf5bdvypkd26dp4ak0lmdf84k73v-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5nqsmf5bdvypkd26dp4ak0lmdf84k73v-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74648 entries in 292 pages78gitlab # [ 0.000000] ftrace: allocated 292 pages with 3 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).104gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns105gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns106gitlab # [ 0.000030] arm-pv: using stolen time PV107gitlab # [ 0.000394] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)108gitlab # [ 0.000602] Console: colour dummy device 80x25109gitlab # [ 0.000610] printk: legacy console [tty0] enabled110gitlab # [ 0.000788] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)111gitlab # [ 0.000795] pid_max: default: 32768 minimum: 301112gitlab # [ 0.000875] LSM: initializing lsm=capability,landlock,yama,bpf,ima113gitlab # [ 0.001015] landlock: Up and running.114gitlab # [ 0.001018] Yama: becoming mindful.115gitlab # [ 0.001454] LSM support for eBPF active116gitlab # [ 0.001662] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)117gitlab # [ 0.001773] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.003000] cacheinfo: Unable to detect cache hierarchy for CPU 0119gitlab # [ 0.003705] rcu: Hierarchical SRCU implementation.120gitlab # [ 0.003709] rcu: Max phase no-delay instances is 1000.121gitlab # [ 0.003886] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level122gitlab # [ 0.004985] fsl-mc MSI: its@8080000 domain created123gitlab # [ 0.005081] EFI services will not be available.124gitlab # [ 0.005245] smp: Bringing up secondary CPUs ...125gitlab # [ 0.005936] Detected PIPT I-cache on CPU1126gitlab # [ 0.006041] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000127gitlab # [ 0.006175] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000128gitlab # [ 0.006308] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]129gitlab # [ 0.007456] Detected PIPT I-cache on CPU2130gitlab # [ 0.007640] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000131gitlab # [ 0.007773] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000132gitlab # [ 0.007904] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]133gitlab # [ 0.008939] Detected PIPT I-cache on CPU3134gitlab # [ 0.009059] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000135gitlab # [ 0.009191] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000136gitlab # [ 0.009319] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]137gitlab # [ 0.009837] smp: Brought up 1 node, 4 CPUs138gitlab # [ 0.009864] SMP: Total of 4 processors activated.139gitlab # [ 0.009866] CPU: All CPU(s) started at EL1140gitlab # [ 0.009875] CPU features: detected: Branch Target Identification141gitlab # [ 0.009879] CPU features: detected: ARMv8.4 Translation Table Level142gitlab # [ 0.009881] CPU features: detected: Instruction cache invalidation not required for I/D coherence143gitlab # [ 0.009885] CPU features: detected: Data cache clean to the PoU not required for I/D coherence144gitlab # [ 0.009888] CPU features: detected: Common not Private translations145gitlab # [ 0.009891] CPU features: detected: CRC32 instructions146gitlab # [ 0.009893] CPU features: detected: Data cache clean to Point of Deep Persistence147gitlab # [ 0.009896] CPU features: detected: Data cache clean to Point of Persistence148gitlab # [ 0.009898] CPU features: detected: Data independent timing control (DIT)149gitlab # [ 0.009901] CPU features: detected: E0PD150gitlab # [ 0.009903] CPU features: detected: Enhanced Counter Virtualization151gitlab # [ 0.009906] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)152gitlab # [ 0.009909] CPU features: detected: Enhanced Virtualization Traps153gitlab # [ 0.009912] CPU features: detected: Fine Grained Traps154gitlab # [ 0.009915] CPU features: detected: Generic authentication (architected QARMA5 algorithm)155gitlab # [ 0.009919] CPU features: detected: RCpc load-acquire (LDAPR)156gitlab # [ 0.009921] CPU features: detected: LSE atomic instructions157gitlab # [ 0.009924] CPU features: detected: Privileged Access Never158gitlab # [ 0.009927] CPU features: detected: PMUv3159gitlab # [ 0.009929] CPU features: detected: RAS Extension Support160gitlab # [ 0.009932] CPU features: detected: RASv1p1 Extension Support161gitlab # [ 0.009934] CPU features: detected: Random Number Generator162gitlab # [ 0.009937] CPU features: detected: Speculation barrier (SB)163gitlab # [ 0.009939] CPU features: detected: Stage-2 Force Write-Back164gitlab # [ 0.009942] CPU features: detected: TLB range maintenance instructions165gitlab # [ 0.009946] CPU features: detected: Speculative Store Bypassing Safe (SSBS)166gitlab # [ 0.010079] alternatives: applying system-wide alternatives167gitlab # [ 0.013073] CPU features: detected: BBM Level 2 without TLB conflict abort168gitlab # [ 0.013296] Memory: 5965812K/6291456K available (24320K kernel code, 7086K rwdata, 26308K rodata, 4736K init, 1102K bss, 270904K reserved, 32768K cma-reserved)169gitlab # [ 0.014852] devtmpfs: initialized170gitlab # [ 0.018942] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns171gitlab # [ 0.018993] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.019057] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.019245] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.019250] 0 pages in range for non-PLT usage175gitlab # [ 0.019251] 508336 pages in range for PLT usage176gitlab # [ 0.019371] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.020166] DMI not present or invalid.178gitlab # [ 0.023543] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.026291] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.026584] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.028445] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.028468] audit: initializing netlink subsys (disabled)183gitlab # [ 0.028786] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.029246] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.029248] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.029253] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.029256] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.029258] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.029334] cpuidle: using governor ladder190gitlab # [ 0.029358] cpuidle: using governor menu191gitlab # [ 0.029562] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.029767] ASID allocator initialised with 65536 entries193gitlab # [ 0.030930] Serial: AMBA PL011 UART driver194gitlab # [ 0.035977] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.036291] printk: console [ttyAMA0] enabled196gitlab # [ 0.043017] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.043023] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.043027] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.043030] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.043032] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.043035] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.043038] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.043041] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.056015] fbcon: Taking over console205gitlab # [ 0.056044] ACPI: Interpreter disabled.206gitlab # [ 0.058732] iommu: Default domain type: Translated207gitlab # [ 0.058739] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.084804] SCSI subsystem initialized209gitlab # [ 0.085342] usbcore: registered new interface driver usbfs210gitlab # [ 0.085375] usbcore: registered new interface driver hub211gitlab # [ 0.085421] usbcore: registered new device driver usb212gitlab # [ 0.085900] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.085905] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.085917] PTP clock support registered215gitlab # [ 0.085972] EDAC MC: Ver: 3.0.0216gitlab # [ 0.086390] scmi_core: SCMI protocol bus registered217gitlab # [ 0.087165] FPGA manager framework218gitlab # [ 0.088078] vgaarb: loaded219gitlab # [ 0.090528] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.091191] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.091225] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.092455] netfs: FS-Cache loaded223gitlab # [ 0.092668] pnp: PnP ACPI: disabled224gitlab # [ 0.104166] NET: Registered PF_INET protocol family225gitlab # [ 0.105665] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.141790] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.141850] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.141900] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.142194] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.142902] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.143014] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.143073] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.143436] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.143644] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.143671] NET: Registered PF_XDP protocol family236gitlab # [ 0.143688] PCI: CLS 0 bytes, default 64237gitlab # [ 0.144034] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.151828] kvm [1]: HYP mode not available239gitlab # [ 0.203541] Initialise system trusted keyrings240gitlab # [ 0.203787] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.204455] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.204588] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.216911] Key type asymmetric registered244gitlab # [ 0.216918] Asymmetric key parser 'x509' registered245gitlab # [ 0.216982] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.217217] io scheduler mq-deadline registered247gitlab # [ 0.217221] io scheduler kyber registered248gitlab # [ 0.223129] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.226921] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.227941] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.227975] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.228011] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.228019] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.228089] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.228122] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.228376] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.228385] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.228404] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.228409] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.228413] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.228578] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.229473] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.229890] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.229913] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.229961] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.229983] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.230851] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.231226] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.231243] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.231282] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.232254] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.232612] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.232629] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.232683] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.233627] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.234040] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.234056] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.234094] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.235022] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.235352] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.235369] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.235412] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.236324] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.236701] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.236718] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.236761] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.237738] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.238154] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.238170] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.238208] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.238224] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.239159] pci 0000:00:08.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint293gitlab # [ 0.239496] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.239534] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.240450] pci 0000:00:09.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint296gitlab # [ 0.240886] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.240924] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.241680] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.242062] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.242469] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.242913] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.242930] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.242992] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.243881] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.244264] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.244280] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.244318] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.245360] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.245369] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.245374] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.245435] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.245534] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.245618] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.245702] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.245798] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.245875] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.245941] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.246024] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.246108] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.246218] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.246280] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.246315] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.246351] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.246387] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.246422] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.246465] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.246491] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.246518] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.246564] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.246589] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.246615] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.246640] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.246678] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.246702] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.246726] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.246751] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.246775] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.246800] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.246824] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.246848] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.246872] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.246903] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.246910] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.246914] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.249375] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.283877] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.289974] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.296995] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.302920] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.309312] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.316913] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.323088] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.330340] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.336193] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.343349] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.351215] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.366199] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.371336] msm_serial: driver initialized359gitlab # [ 0.371727] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.371854] STM32 USART driver initialized361gitlab # [ 0.411284] loop: module loaded362gitlab # [ 0.411807] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.415764] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.419445] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.422936] virtio_blk virtio5: [vdb] 11844624 512-byte logical blocks (6.06 GB/5.65 GiB)366gitlab # [ 0.426753] megasas: 07.734.00.00-rc1367gitlab # [ 0.428181] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.431594] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.431658] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.434798] Using buffer write method371gitlab # [ 0.434855] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.438295] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.438325] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.443467] Using buffer write method375gitlab # [ 0.443497] Concatenating MTD devices:376gitlab # [ 0.443501] (0): "0.flash"377gitlab # [ 0.443505] (1): "0.flash"378gitlab # [ 0.443509] into device "0.flash"379gitlab # [ 0.585114] Freeing initrd memory: 25372K380gitlab # [ 0.603795] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.612596] thunder_xcv, ver 1.0382gitlab # [ 0.612698] thunder_bgx, ver 1.0383gitlab # [ 0.612753] nicpf, ver 1.0384gitlab # [ 0.614336] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.614348] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.614431] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.614445] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.614563] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.614572] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.614633] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.614642] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.615125] sky2: driver version 1.30393gitlab # [ 0.619824] usbcore: registered new interface driver usb-storage394gitlab # [ 0.620008] ehci-pci 0000:00:0a.0: EHCI Host Controller395gitlab # [ 0.620059] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1396gitlab # [ 0.620272] usbcore: registered new interface driver usbserial_generic397gitlab # [ 0.620314] usbserial: USB Serial support registered for generic398gitlab # [ 0.620768] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.621982] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.624531] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.624589] rtc-pl031 9010000.pl031: setting system clock to 2026-07-28T08:12:41 UTC (1785226361)402gitlab # [ 0.625453] i2c_dev: i2c /dev entries driver403gitlab # [ 0.630634] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.631580] hub 1-0:1.0: USB hub found405gitlab # [ 0.631623] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.633540] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.633556] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.634289] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.635351] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.639745] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.640524] usbcore: registered new interface driver usbhid412gitlab # [ 0.640533] usbhid: USB HID core driver413gitlab # [ 0.683456] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.688337] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.688739] NET: Registered PF_INET6 protocol family416gitlab # [ 0.691320] Segment Routing with IPv6417gitlab # [ 0.691384] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.691476] NET: Registered PF_PACKET protocol family419gitlab # [ 0.691943] 9pnet: Installing 9P2000 support420gitlab # [ 0.695943] Key type dns_resolver registered421gitlab # [ 0.710630] registered taskstats version 1422gitlab # [ 0.711136] Loading compiled-in X.509 certificates423gitlab # [ 0.730220] Demotion targets for Node 0: null424gitlab # [ 0.730574] Key type .fscrypt registered425gitlab # [ 0.730583] Key type fscrypt-provisioning registered426gitlab # [ 0.730782] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.730805] ima: Allocated hash algorithm: sha1428gitlab # [ 0.730850] ima: No architecture policies found429gitlab # [ 0.732175] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.762376] clk: Disabling unused clocks431gitlab # [ 0.762414] PM: genpd: Disabling unused power domains432gitlab # [ 0.768035] Freeing unused kernel memory: 4736K433gitlab # [ 0.768269] Run /init as init process434gitlab # [ 0.805981] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.878616] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.031604] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.119342] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.140796] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.140864] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.140935] systemd[1]: Detected architecture arm64.441gitlab # [ 1.140952] systemd[1]: Running in initrd.442gitlab # [ 1.141941] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.142341] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.238646] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.299838] systemd[1]: Queued start job for default target Initrd Default Target.446gitlab # [ 1.397288] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.397932] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.552957] systemd[1]: Created slice Slice /system/modprobe.449gitlab # [ 1.553632] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.450gitlab # [ 1.553714] systemd[1]: Expecting device /dev/disk/by-label/nix-store...451gitlab # [ 1.553741] systemd[1]: Expecting device /dev/disk/by-label/nixos...452gitlab # [ 1.553798] systemd[1]: Reached target Path Units.453gitlab # [ 1.553836] systemd[1]: Reached target Slice Units.454gitlab # [ 1.553874] systemd[1]: Reached target Swaps.455gitlab # [ 1.553916] systemd[1]: Reached target Timer Units.456gitlab # [ 1.554288] systemd[1]: Listening on D-Bus System Message Bus Socket.457gitlab # [ 1.554700] systemd[1]: Listening on Journal Socket (/dev/log).458gitlab # [ 1.555027] systemd[1]: Listening on Journal Sockets.459gitlab # [ 1.555321] systemd[1]: Listening on udev Control Socket.460gitlab # [ 1.555488] systemd[1]: Listening on udev Kernel Socket.461gitlab # [ 1.555529] systemd[1]: Reached target Socket Units.462gitlab # [ 1.563492] systemd[1]: Starting Create List of Static Device Nodes...463gitlab # [ 1.571900] systemd[1]: Starting Load Kernel Module 9pnet_virtio...464gitlab # [ 1.572069] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs465gitlab # [ 1.595699] systemd[1]: Mounting Kernel Configuration File System...466gitlab # [ 1.608953] systemd[1]: Starting Journal Service...467gitlab # [ 1.618493] systemd[1]: Starting Load Kernel Modules...468gitlab # [ 1.620564] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki469gitlab # [ 1.631199] systemd[1]: Starting Coldplug All udev Devices...470gitlab # [ 1.649351] systemd[1]: Finished Create List of Static Device Nodes.471gitlab # [ 1.656662] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.472gitlab # [ 1.660429] systemd-journald[156]: Collecting audit messages is disabled.473gitlab # [ 1.667234] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.668559] [drm] pci: virtio-gpu-pci detected at 0000:00:09.0475gitlab # [ 1.668993] [drm] features: -virgl +edid -resource_blob -host_visible476gitlab # [ 1.669015] [drm] features: -context_init477gitlab # [ 1.670237] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.478gitlab # [ 1.670276] [drm] number of scanouts: 1479gitlab # [ 1.670308] [drm] number of cap sets: 0480gitlab # [ 1.670747] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev481gitlab # [ 1.677478] systemd[1]: Mounted Kernel Configuration File System.482gitlab # [ 1.679185] virtio-pci 0000:00:09.0: [drm] Registered 1 planes with drm panic483gitlab # [ 1.679198] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:09.0 on minor 0484gitlab # [ 1.689215] Console: switching to colour frame buffer device 160x50485gitlab # [ 1.695843] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...486gitlab # [ 1.696862] virtio-pci 0000:00:09.0: [drm] fb0: virtio_gpudrmfb frame buffer device487gitlab # [ 1.716992] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.488gitlab # [ 1.723127] systemd[1]: Finished Load Kernel Modules.489gitlab # [ 1.728014] systemd[1]: Starting Apply Kernel Variables...490gitlab # [ 1.733866] systemd[1]: Starting Create Static Device Nodes in /dev...491gitlab # [ 1.764707] systemd-modules-load[158]: Using 4 probe threads492gitlab # [ 1.766342] systemd-modules-load[158]: Module 'virtio_balloon' is built in493gitlab # [ 1.767842] systemd-modules-load[158]: Module 'virtio_console' is built in494gitlab # [ 1.772297] systemd[1]: Started Journal Service.495gitlab # [ 1.773018] systemd-modules-load[158]: Module 'virtio_rng' is built in496gitlab # [ 1.775325] systemd-modules-load[158]: Inserted module 'dm_mod'497gitlab # [ 1.777033] systemd-modules-load[158]: Inserted module 'virtio_gpu'498gitlab # [ 1.787077] systemd[1]: Finished Create Static Device Nodes in /dev.499gitlab # [ 1.793522] systemd[1]: Finished Apply Kernel Variables.500gitlab # [ 1.796473] systemd[1]: Reached target Preparation for Local File Systems.501gitlab # [ 1.798121] systemd[1]: Reached target Local File Systems.502gitlab # [ 1.802091] systemd[1]: Starting Create System Files and Directories...503gitlab # [ 1.808556] systemd[1]: Starting Rule-based Manager for Device Events and Files...504gitlab # [ 1.860075] systemd[1]: Finished Create System Files and Directories.505gitlab # [ 1.873447] systemd-udevd[192]: Using default interface naming scheme 'v260'.506gitlab # [ 1.900942] systemd[1]: Started Rule-based Manager for Device Events and Files.507gitlab # [ 1.934861] systemd[1]: Starting Virtual Console Setup...508gitlab # [ 2.020660] systemd-vconsole-setup[208]: Configuration of first virtual console was skipped, ignoring remaining ones.509gitlab # [ 2.029101] systemd[1]: Finished Virtual Console Setup.510gitlab # [ 2.410929] systemd[1]: Finished Coldplug All udev Devices.511gitlab # [ 2.411946] systemd[1]: Reached target System Initialization.512gitlab # [ 2.413091] systemd[1]: Reached target Basic System.513gitlab # [ 2.629679] (udev-worker)[201]: Network interface NamePolicy= disabled on kernel command line.514gitlab # [ 2.634761] (udev-worker)[214]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.640882] (udev-worker)[214]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.652126] systemd[1]: Found device /dev/disk/by-label/nixos.517gitlab # [ 2.660661] systemd[1]: Found device /dev/disk/by-label/nix-store.518gitlab # [ 2.661958] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.672121] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.717083] systemd-fsck[233]: nixos: clean, 12/65536 files, 13019/262144 blocks521gitlab # [ 2.723580] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.522gitlab # [ 2.730135] systemd[1]: Mounting /sysroot...523gitlab # [ 2.762605] EXT4-fs (vda): mounted filesystem ab50475c-f24a-450e-b692-5d166586237a r/w with ordered data mode. Quota mode: none.524gitlab # [ 2.763127] systemd[1]: Mounted /sysroot.525gitlab # [ 2.764667] systemd[1]: Reached target Initrd Root File System.526gitlab # [ 2.768614] systemd[1]: Starting Mountpoints Configured in the Real Root...527gitlab # [ 2.801641] systemd-sysroot-fstab-check[244]: /sysroot should be mounted in the initrd, will request daemon-reload.528gitlab # [ 2.804963] systemd[1]: Reload requested from client PID 244 ('systemd-sysroot') (unit initrd-parse-etc.service)...529gitlab # [ 2.806613] systemd[1]: Reloading...530gitlab # [ 3.114263] systemd[1]: Reloading finished in 308 ms.531gitlab # [ 3.152814] systemd-sysroot-fstab-check[244]: Requesting initrd-fs.target/start/replace...532gitlab # [ 3.260242] systemd-sysroot-fstab-check[244]: Requesting swap.target/start/replace...533gitlab # [ 3.263989] systemd[1]: Starting Load Kernel Module 9pnet_virtio...534gitlab # [ 3.268397] systemd[1]: initrd-parse-etc.service: Deactivated successfully.535gitlab # [ 3.270367] systemd[1]: Finished Mountpoints Configured in the Real Root.536gitlab # [ 3.271410] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.537gitlab # [ 3.294427] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.538gitlab # [ 3.297118] systemd[1]: Finished Load Kernel Module 9pnet_virtio.539gitlab # [ 3.305025] (udev-worker)[219]: mtd0ro: Failed to find and pin callout binary "/nix/store/3x4plcsrj2r4mmzis46wrmyka8g4jhi8-systemd-260.1/lib/udev/mtd_probe": No such file or directory540gitlab # [ 3.308132] (udev-worker)[219]: mtd0ro: /nix/store/3x4plcsrj2r4mmzis46wrmyka8g4jhi8-systemd-260.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory541gitlab # [ 3.315369] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.542gitlab # [ 3.317096] systemd[1]: Stopped Virtual Console Setup.543gitlab # [ 3.319024] systemd[1]: Stopping Virtual Console Setup...544gitlab # [ 3.322182] systemd[1]: Starting Virtual Console Setup...545gitlab # [ 3.341015] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.546gitlab # [ 3.343123] systemd[1]: Stopped Virtual Console Setup.547gitlab # [ 3.349352] systemd[1]: Starting Virtual Console Setup...548gitlab # [ 3.376540] systemd-vconsole-setup[458]: Configuration of first virtual console was skipped, ignoring remaining ones.549gitlab # [ 3.381307] systemd[1]: Finished Virtual Console Setup.550gitlab # [ 3.653090] systemd[1]: Mounting /sysroot/nix/.ro-store...551gitlab # [ 3.662284] systemd[1]: Mounting /sysroot/nix/.rw-store...552gitlab # [ 3.685740] systemd[1]: Mounting /sysroot/run...553gitlab # [ 3.700221] systemd[1]: Mounting /sysroot/tmp/shared...554gitlab # [ 3.710935] systemd[1]: Mounting /sysroot/tmp/xchg...555gitlab # [ 3.722136] erofs (device vdb): mounted with root inode @ nid 128.556gitlab # [ 3.743320] systemd[1]: Mounted /sysroot/nix/.ro-store.557gitlab # [ 3.745989] systemd[1]: Mounted /sysroot/nix/.rw-store.558gitlab # [ 3.748483] systemd[1]: Mounted /sysroot/run.559gitlab # [ 3.750490] systemd[1]: Mounted /sysroot/tmp/shared.560gitlab # [ 3.752834] systemd[1]: Mounted /sysroot/tmp/xchg.561gitlab # [ 3.760853] systemd[1]: Starting rw-sysroot-nix-store.service...562gitlab # [ 3.797754] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.563gitlab # [ 3.804282] systemd[1]: Finished rw-sysroot-nix-store.service.564gitlab # [ 4.650541] systemd[1]: Mounting /sysroot/nix/store...565gitlab # [ 4.729287] systemd[1]: Mounted /sysroot/nix/store.566gitlab # [ 4.731757] systemd[1]: Reached target Initrd File Systems.567gitlab # [ 4.739590] systemd[1]: Starting Find NixOS closure...568gitlab # [ 4.747895] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...569gitlab # [ 4.806449] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.570gitlab # [ 4.810406] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.571gitlab # [ 4.833895] systemd[1]: Finished Find NixOS closure.572gitlab # [ 4.836441] systemd[1]: Reached target Initrd Default Target.573gitlab # [ 4.843797] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...574gitlab # [ 4.890537] systemd[1]: Stopped target Initrd Default Target.575gitlab # [ 4.893330] systemd[1]: Stopped target Basic System.576gitlab # [ 4.895608] systemd[1]: Stopped target Initrd Root Device.577gitlab # [ 4.898183] systemd[1]: Stopped target Path Units.578gitlab # [ 4.900398] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.579gitlab # [ 4.903692] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.580gitlab # [ 4.907241] systemd[1]: Stopped target Slice Units.581gitlab # [ 4.909554] systemd[1]: Stopped target Socket Units.582gitlab # [ 4.911809] systemd[1]: Stopped target System Initialization.583gitlab # [ 4.914488] systemd[1]: Stopped target Swaps.584gitlab # [ 4.916577] systemd[1]: Stopped target Timer Units.585gitlab # [ 4.918787] systemd[1]: dbus.socket: Deactivated successfully.586gitlab # [ 4.921454] systemd[1]: Closed D-Bus System Message Bus Socket.587gitlab # [ 4.924099] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.588gitlab # [ 4.927100] systemd[1]: Stopped Find NixOS closure.589gitlab # [ 4.929135] systemd[1]: Starting Load Kernel Module 9pnet_virtio...590gitlab # [ 4.931428] systemd[1]: Starting rw-sysroot-nix-store.service...591gitlab # [ 4.933660] systemd[1]: systemd-sysctl.service: Deactivated successfully.592gitlab # [ 4.935966] systemd[1]: Stopped Apply Kernel Variables.593gitlab # [ 4.940830] systemd[1]: systemd-modules-load.service: Deactivated successfully.594gitlab # [ 4.943700] systemd[1]: Stopped Load Kernel Modules.595gitlab # [ 4.950908] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.596gitlab # [ 4.954346] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.597gitlab # [ 4.962794] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.598gitlab # [ 4.966492] systemd[1]: Stopped Create System Files and Directories.599gitlab # [ 4.974819] systemd[1]: Stopped target Local File Systems.600gitlab # [ 4.977449] systemd[1]: Stopped target Preparation for Local File Systems.601gitlab # [ 4.980510] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.602gitlab # [ 4.983651] systemd[1]: Stopped Coldplug All udev Devices.603gitlab # [ 4.986258] systemd[1]: Stopping Rule-based Manager for Device Events and Files...604gitlab # [ 4.989579] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.605gitlab # [ 4.992829] systemd[1]: Stopped Virtual Console Setup.606gitlab # [ 5.006173] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.607gitlab # [ 5.011363] systemd[1]: Finished Load Kernel Module 9pnet_virtio.608gitlab # [ 5.022256] systemd[1]: systemd-udevd.service: Deactivated successfully.609gitlab # [ 5.027547] systemd[1]: Stopped Rule-based Manager for Device Events and Files.610gitlab # [ 5.030855] systemd[1]: systemd-udevd.service: Consumed 2.579s CPU time over 3.214s wall clock time, 32.2M memory peak.611gitlab # [ 5.038392] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.612gitlab # [ 5.043369] systemd[1]: Finished rw-sysroot-nix-store.service.613gitlab # [ 5.062879] systemd[1]: initrd-cleanup.service: Deactivated successfully.614gitlab # [ 5.068428] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.615gitlab # [ 5.085291] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.616gitlab # [ 5.088773] systemd[1]: Closed udev Control Socket.617gitlab # [ 5.101585] systemd[1]: Starting Cleanup udev Database...618gitlab # [ 5.104076] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.619gitlab # [ 5.107381] systemd[1]: Stopped Create Static Device Nodes in /dev.620gitlab # [ 5.112047] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.621gitlab # [ 5.115607] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.622gitlab # [ 5.121396] systemd[1]: kmod-static-nodes.service: Deactivated successfully.623gitlab # [ 5.124483] systemd[1]: Stopped Create List of Static Device Nodes.624gitlab # [ 5.218681] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.625gitlab # [ 5.224370] systemd[1]: Finished Cleanup udev Database.626gitlab # [ 5.234338] systemd[1]: Reached target Switch Root.627gitlab # [ 5.241920] systemd[1]: Starting NixOS Activation...628gitlab # [ 5.442505] initrd-nixos-activation-start[564]: booting system configuration /nix/store/7c6izzib9bj71bg1bazr77mdx3xfmnr4-nixos-system-gitlab-test629gitlab # [ 5.511822] initrd-nixos-activation-start[564]: running activation script...630gitlab # [ 5.846141] initrd-nixos-activation-start[587]: setting up /etc...631gitlab # [ 6.031051] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.632gitlab # [ 6.035774] systemd[1]: Finished NixOS Activation.633gitlab # [ 6.053669] systemd[1]: Starting Switch Root...634gitlab # [ 6.118253] systemd[1]: Switching root.635gitlab # [ 6.795662] systemd-journald[156]: Received SIGTERM from PID 1 (systemd).636gitlab # [ 7.550208] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)637gitlab # [ 7.550345] systemd[1]: Detected virtualization qemu.638gitlab # [ 7.550471] systemd[1]: Detected architecture arm64.639gitlab # [ 7.550740] systemd[1]: Detected first boot.640gitlab # [ 7.552381] systemd[1]: Initializing machine ID from random generator.641gitlab # [ 7.811781] systemd[1]: bpf-restrict-fs: LSM BPF program attached642gitlab # [ 7.910818] systemd[1]: Applying preset policy.643gitlab # [ 8.118508] systemd[1]: Populated /etc with preset unit settings.644gitlab # [ 8.265650] systemd[1]: initrd-switch-root.service: Deactivated successfully.645gitlab # [ 8.266081] systemd[1]: Stopped initrd-switch-root.service.646gitlab # [ 8.268836] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.647gitlab # [ 8.273491] systemd[1]: Created slice Slice /system/getty.648gitlab # [ 8.279934] systemd[1]: Created slice GitLab DevOps Platform Slice.649gitlab # [ 8.283375] systemd[1]: Created slice User and Session Slice.650gitlab # [ 8.283912] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.651gitlab # [ 8.284651] systemd[1]: Started Forward Password Requests to Wall Directory Watch.652gitlab # [ 8.285362] systemd[1]: Expecting device /dev/hvc0...653gitlab # [ 8.286097] systemd[1]: Expecting device /dev/ttyAMA0...654gitlab # [ 8.290784] systemd[1]: Reached target Local Encrypted Volumes.655gitlab # [ 8.291764] systemd[1]: Stopped target initrd-fs.target.656gitlab # [ 8.292485] systemd[1]: Stopped target initrd-root-fs.target.657gitlab # [ 8.293176] systemd[1]: Stopped target initrd-switch-root.target.658gitlab # [ 8.293872] systemd[1]: Reached target Virtual Machines and Containers.659gitlab # [ 8.294906] systemd[1]: Reached target Path Units.660gitlab # [ 8.295994] systemd[1]: Reached target Remote File Systems.661gitlab # [ 8.297075] systemd[1]: Reached target Slice Units.662gitlab # [ 8.298138] systemd[1]: Reached target Swaps.663gitlab # [ 8.302763] systemd[1]: Listening on Process Core Dump Socket.664gitlab # [ 8.306031] systemd[1]: Listening on Credential Encryption/Decryption.665gitlab # [ 8.317254] systemd[1]: Starting Journal Log Access Socket...666gitlab # [ 8.319362] systemd[1]: Listening on Journal Audit Socket.667gitlab # [ 8.320179] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.668gitlab # [ 8.320671] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki669gitlab # [ 8.321561] systemd[1]: Listening on udev Control Socket.670gitlab # [ 8.327548] systemd[1]: Mounting Huge Pages File System...671gitlab # [ 8.334291] systemd[1]: Mounting POSIX Message Queue File System...672gitlab # [ 8.342856] systemd[1]: Mounting Kernel Debug File System...673gitlab # [ 8.360198] systemd[1]: Mounting Kernel Trace File System...674gitlab # [ 8.368298] systemd[1]: Starting Create List of Static Device Nodes...675gitlab # [ 8.374585] systemd[1]: Starting Load Kernel Module 9pnet_virtio...676gitlab # [ 8.375889] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs677gitlab # [ 8.386789] systemd[1]: Mounting Kernel Configuration File System...678gitlab # [ 8.387288] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm679gitlab # [ 8.387691] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore680gitlab # [ 8.394549] systemd[1]: Starting Load Kernel Module fuse...681gitlab # [ 8.395930] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67682gitlab # [ 8.409966] systemd[1]: Starting Journal Service...683gitlab # [ 8.413787] systemd[1]: Starting Load Kernel Modules...684gitlab # [ 8.419085] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...685gitlab # [ 8.430832] systemd[1]: Starting Remount Root and Kernel File Systems...686gitlab # [ 8.431658] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki687gitlab # [ 8.439507] fuse: init (API version 7.45)688gitlab # [ 8.446816] systemd[1]: Starting Coldplug All udev Devices...689gitlab # [ 8.459428] systemd[1]: Listening on Journal Log Access Socket.690gitlab # [ 8.460557] systemd[1]: Mounted Huge Pages File System.691gitlab # [ 8.461562] systemd[1]: Mounted POSIX Message Queue File System.692gitlab # [ 8.462700] systemd[1]: Mounted Kernel Debug File System.693gitlab # [ 8.463657] systemd[1]: Mounted Kernel Trace File System.694gitlab # [ 8.466665] systemd[1]: Finished Create List of Static Device Nodes.695gitlab # [ 8.468723] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.696gitlab # [ 8.469972] systemd[1]: Finished Load Kernel Module 9pnet_virtio.697gitlab # [ 8.472979] EXT4-fs (vda): re-mounted ab50475c-f24a-450e-b692-5d166586237a.698gitlab # [ 8.475289] systemd[1]: Mounted Kernel Configuration File System.699gitlab # [ 8.477577] systemd-journald[796]: Collecting audit messages is enabled.700gitlab # [ 8.480133] systemd[1]: modprobe@fuse.service: Deactivated successfully.701gitlab # [ 8.481465] systemd[1]: Finished Load Kernel Module fuse.702gitlab # [ 8.485571] systemd[1]: Finished Load Kernel Modules.703gitlab # [ 8.487658] systemd[1]: Finished Remount Root and Kernel File Systems.704gitlab # [ 8.500114] systemd[1]: Mounting FUSE Control File System...705gitlab # [ 8.504994] systemd[1]: Queued start job for default target Multi-User System.706gitlab # [ 8.506441] systemd[1]: Unnecessary job was removed for /dev/vdb.707gitlab # [ 8.508828] systemd[1]: systemd-journald.service: Deactivated successfully.708gitlab # [ 8.513654] systemd[1]: Starting Firewall...709gitlab # [ 8.514569] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore710gitlab # [ 8.519235] systemd-modules-load[797]: Using 3 probe threads711gitlab # [ 8.521961] systemd-modules-load[797]: Module 'atkbd' is built in712gitlab # [ 8.524619] systemd-modules-load[797]: Module 'loop' is built in713gitlab # [ 8.526946] systemd-modules-load[797]: Inserted module 'tls'714gitlab # [ 8.535408] systemd-oomd[798]: No swap; memory pressure usage will be degraded715gitlab # [ 8.547568] systemd[1]: Starting Load/Save OS Random Seed...716gitlab # [ 8.553336] systemd[1]: Starting Apply Kernel Variables...717gitlab # [ 8.562773] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...718gitlab # [ 8.564852] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.[ 8.563241] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki719gitlab # [ 8.565778] systemd[1]: Started Journal Service.720gitlab # 721gitlab # [ 8.574231] systemd[1]: Mounted FUSE Control File System.722gitlab # [ 8.609930] systemd[1]: Starting Flush Journal to Persistent Storage...723gitlab # [ 8.613405] systemd[1]: Finished Load/Save OS Random Seed.724gitlab # [ 8.615429] systemd[1]: Finished Apply Kernel Variables.725gitlab # [ 8.626718] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.726gitlab # [ 8.630631] systemd[1]: Reached target First Boot Complete.727gitlab # [ 8.642759] systemd-journald[796]: Received client request to flush runtime journal.728gitlab # [ 8.671193] systemd[1]: Starting Create Static Device Nodes in /dev...729gitlab # [ 8.673408] systemd[1]: Finished Create Static Device Nodes in /dev.730gitlab # [ 8.674509] systemd[1]: Reached target Preparation for Local File Systems.731gitlab # [ 8.676579] systemd[1]: Starting Rule-based Manager for Device Events and Files...732gitlab # [ 8.678933] systemd[1]: Finished Flush Journal to Persistent Storage.733gitlab # [ 8.764546] systemd-udevd[852]: Using default interface naming scheme 'v260'.734gitlab # [ 8.820144] systemd[1]: Started Rule-based Manager for Device Events and Files.735gitlab # [ 9.003162] systemd[1]: Finished Firewall.736gitlab # [ 9.226696] systemd[1]: Finished Coldplug All udev Devices.737gitlab # [ 9.270507] systemd[1]: Mounting /run/wrappers...738gitlab # [ 9.300390] systemd[1]: Mounted /run/wrappers.739gitlab # [ 9.303009] systemd[1]: Reached target Local File Systems.740gitlab # [ 9.307085] systemd[1]: Listening on Boot Loader Control Service Socket.741gitlab # [ 9.311953] systemd[1]: Starting register-nix-paths.service...742gitlab # [ 9.316385] systemd[1]: Starting Create SUID/SGID Wrappers...743gitlab # [ 9.318455] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.744gitlab # [ 9.340219] systemd[1]: Starting Save Transient machine-id to Disk...745gitlab # [ 9.345105] systemd[1]: Starting Create System Files and Directories...746gitlab # [ 9.346763] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 9.439285] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.748gitlab # [ 9.444353] systemd[1]: Finished Save Transient machine-id to Disk.749gitlab # [ 9.445847] systemd[1]: Finished Create System Files and Directories.750gitlab # [ 9.458932] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.751gitlab # [ 9.464677] (udev-worker)[957]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.752gitlab # [ 9.470666] (udev-worker)[957]: Network interface NamePolicy= disabled on kernel command line.753gitlab # [ 9.475095] systemd[1]: Starting Rebuild Journal Catalog...754gitlab # [ 9.476719] (udev-worker)[897]: Network interface NamePolicy= disabled on kernel command line.755gitlab # [ 9.478791] systemd[1]: Starting Record System Boot/Shutdown in UTMP...756gitlab # [ 9.493088] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.757gitlab # [ 9.500644] systemd[1]: Condition check resulted in Virtio network device being skipped.758gitlab # [ 9.503237] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore759gitlab # [ 9.505449] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.760gitlab # [ 9.506759] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67761gitlab # [ 9.509537] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore762gitlab # [ 9.511256] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki763gitlab # [ 9.513842] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki764gitlab # [ 9.537367] systemd[1]: Finished Record System Boot/Shutdown in UTMP.765gitlab # [ 9.546774] systemd[1]: Finished Rebuild Journal Catalog.766gitlab # [ 9.549021] systemd[1]: Starting Update is Completed...767gitlab # [ 9.582429] systemd[1]: Finished Update is Completed.768gitlab # [ 9.625597] mousedev: PS/2 mouse device common for all mice769gitlab # [ 9.632248] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.770gitlab # [ 9.633951] systemd[1]: Finished Create SUID/SGID Wrappers.771gitlab # [ 9.635323] systemd[1]: suid-sgid-wrappers.service: Consumed 205ms CPU time over 314ms wall clock time, 6.7M memory peak, 2.2M read from disk.772gitlab # [ 9.873379] systemd[1]: Finished register-nix-paths.service.773gitlab # [ 9.875386] systemd[1]: Reached target System Initialization.774gitlab # [ 9.878649] systemd[1]: Started Discard unused filesystem blocks once a week.775gitlab # [ 9.880426] systemd[1]: Started logrotate.timer.776gitlab # [ 9.881228] systemd[1]: Started Daily Cleanup of Temporary Directories.777gitlab # [ 9.882200] systemd[1]: Reached target Timer Units.778gitlab # [ 9.882969] systemd[1]: Listening on D-Bus System Message Bus Socket.779gitlab # [ 9.884163] systemd[1]: Listening on Nix Daemon Socket.780gitlab # [ 9.900121] systemd[1]: Starting nixbot CI service socket...781gitlab # [ 9.901153] systemd[1]: Listening on Hostname Service Socket.782gitlab # [ 9.905576] systemd[1]: Starting D-Bus System Message Bus...783gitlab # [ 9.907031] systemd[1]: Listening on nixbot CI service socket.784gitlab # [ 9.908007] systemd[1]: Reached target Socket Units.785gitlab # [ 9.949482] dbus-broker-launch[1048]: Looking up NSS user entry for 'systemd-timesync'...786gitlab # [ 9.951099] dbus-broker-launch[1048]: NSS returned no entry for 'systemd-timesync'787gitlab # [ 9.952536] dbus-broker-launch[1048]: Invalid user-name in /nix/store/ifm9k575wb3j66gvjx1xkdmmknzqr8v8-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"788gitlab # [ 9.955261] systemd[1]: Started D-Bus System Message Bus.789gitlab # [ 9.968953] dbus-broker-launch[1048]: Ready790gitlab # [ 9.969970] systemd[1]: Reached target Basic System.791gitlab # [ 9.972476] systemd[1]: Started backdoor.service.792gitlab # [ 9.977609] systemd[1]: Starting gitlab-config.service...793gitlab # [ 9.978926] systemd[1]: Starting Import lastlog data into lastlog2 database...794gitlab # [ 9.994245] systemd[1]: Starting Logrotate configuration check...795gitlab # [ 10.004662] systemd[1]: Starting Name Service Cache Daemon (nsncd)...796gitlab # [ 10.006808] systemd[1]: Starting Post-Boot Actions...797gitlab # connecting to host...798gitlab # [ 10.017727] systemd[1]: Started Reset console on configuration changes.799gitlab # [ 10.019274] logrotate[1053]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.800gitlab # [ 10.022521] logrotate[1053]: reading config file /nix/store/hk6ay5j24mh4h8mpr5rxlxxxp8v61fnj-logrotate.conf801gitlab # [ 10.023895] logrotate[1053]: note: 'monthly' overrides previously specified 'weekly'802gitlab # [ 10.025107] logrotate[1053]: Reading state from file: /var/lib/logrotate.status803gitlab # [ 10.026198] logrotate[1053]: state file /var/lib/logrotate.status does not exist804gitlab # [ 10.027207] logrotate[1053]: Allocating hash table for state file, size 64 entries805gitlab # [ 10.032218] logrotate[1053]: Handling 4 logs806gitlab # [ 10.032968] logrotate[1053]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed807gitlab # [ 10.035059] logrotate[1053]: considering log /var/log/btmp808gitlab # [ 10.035825] logrotate[1053]: Creating new state809gitlab # [ 10.036601] logrotate[1053]: Now: 2026-07-28 08:12810gitlab # [ 10.037344] logrotate[1053]: Last rotated at 2026-07-28 08:00811gitlab # [ 10.038139] logrotate[1053]: log does not need rotating (log has already been rotated)812gitlab: Guest shell says: b'Spawning backdoor root shell...\n'813gitlab: connected to guest root shell814gitlab # [ 10.039210] logrotate[1053]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed815gitlab: (connecting took 10.51 seconds)816gitlab # [ 10.041959] logrotate[1053]: considering log /var/log/wtmp817gitlab: (finished: waiting for the VM to finish booting, in 10.51 seconds)818gitlab # [ 10.042661] logrotate[1053]: Creating new state819gitlab # [ 10.043301] logrotate[1053]: Now: 2026-07-28 08:12820gitlab # [ 10.043944] logrotate[1053]: Last rotated at 2026-07-28 08:00821gitlab # [ 10.044773] logrotate[1053]: log does not need rotating (log has already been rotated)822gitlab # [ 10.045805] logrotate[1053]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed823gitlab # [ 10.047587] logrotate[1053]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1053)824gitlab # [ 10.051505] logrotate[1053]: considering log /var/gitlab/state/log/*.log825gitlab # [ 10.052546] logrotate[1053]: log /var/gitlab/state/log/*.log does not exist -- skipping826gitlab # [ 10.053554] logrotate[1053]: Creating new state827gitlab # [ 10.054149] logrotate[1053]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1053)828gitlab # [ 10.055259] logrotate[1053]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed829gitlab # [ 10.061640] logrotate[1053]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1053)830gitlab # [ 10.062755] logrotate[1053]: considering log /var/log/nginx/*.log831gitlab # [ 10.063652] logrotate[1053]: log /var/log/nginx/*.log does not exist -- skipping832gitlab # [ 10.067645] logrotate[1053]: Creating new state833gitlab # [ 10.068413] logrotate[1053]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1053)834gitlab # [ 10.069553] systemd[1]: Starting resolvconf update...835gitlab # [ 10.070782] nsncd[1054]: Jul 28 08:12:50.943 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"836gitlab # [ 10.076753] systemd[1]: Finished Logrotate configuration check.837gitlab # [ 10.080442] systemd[1]: Finished Post-Boot Actions.838gitlab # [ 10.081397] systemd[1]: Finished Import lastlog data into lastlog2 database.839gitlab # [ 10.082523] systemd[1]: Started Name Service Cache Daemon (nsncd).840gitlab # [ 10.083557] systemd[1]: Reached target Host and Network Name Lookups.841gitlab # [ 10.088394] systemd[1]: Reached target User and Group Name Lookups.842gitlab # [ 10.089324] systemd[1]: Starting User Login Management...843gitlab # [ 10.153670] systemd[1]: Stopped target Host and Network Name Lookups.844gitlab # [ 10.154833] systemd[1]: Stopping Host and Network Name Lookups...845gitlab # [ 10.156259] systemd[1]: Stopped target User and Group Name Lookups.846gitlab # [ 10.157235] systemd[1]: Stopping User and Group Name Lookups...847gitlab # [ 10.160497] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...848gitlab # [ 10.164116] systemd[1]: nscd.service: Deactivated successfully.849gitlab # [ 10.165062] systemd[1]: Stopped Name Service Cache Daemon (nsncd).850gitlab # [ 10.165926] systemd[1]: nscd.service: Consumed 28ms CPU time over 160ms wall clock time, 8.3M memory peak, 5.9M read from disk.851gitlab # [ 10.180623] systemd[1]: Starting Name Service Cache Daemon (nsncd)...852gitlab # [ 10.213241] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:08.0/virtio7/input/input3853gitlab # [ 10.224090] systemd[1]: Finished resolvconf update.854gitlab # [ 10.228720] systemd[1]: Reached target Preparation for Network.855gitlab # [ 10.232498] nsncd[1140]: Jul 28 08:12:51.109 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"856gitlab # [ 10.237718] systemd[1]: Starting DHCP Client...857gitlab # [ 10.244724] systemd[1]: Starting Address configuration of eth1...858gitlab # [ 10.250562] systemd[1]: Starting Extra networking commands....859gitlab # [ 10.251568] systemd[1]: Started Name Service Cache Daemon (nsncd).860gitlab # [ 10.252513] systemd[1]: Reached target Host and Network Name Lookups.861gitlab # [ 10.253454] systemd[1]: Reached target User and Group Name Lookups.862gitlab # [ 10.262553] systemd-logind[1087]: New seat seat0.863gitlab # [ 10.274926] systemd-logind[1087]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)864gitlab # [ 10.276356] systemd-logind[1087]: Watching system buttons on /dev/input/event0 (gpio-keys)865gitlab # [ 10.278825] systemd[1]: Started User Login Management.866gitlab # [ 10.290701] systemd[1]: Starting linger-users.service...867gitlab # [ 10.312331] systemd[1]: linger-users.service: Deactivated successfully.868gitlab # [ 10.313541] systemd[1]: Finished linger-users.service.869gitlab # [ 10.321654] network-addresses-eth1-start[1165]: adding address 192.168.1.1/24... done870gitlab # [ 10.327992] network-addresses-eth1-start[1165]: adding address 2001:db8:1::1/64... done871gitlab # [ 10.340707] systemd[1]: Finished Address configuration of eth1.872gitlab # [ 10.376915] dhcpcd[1175]: dhcpcd-10.3.2 starting873gitlab # [ 10.380343] dhcpcd[1219]: dev: loaded udev874gitlab # [ 10.394982] 8021q: 802.1Q VLAN Support v1.8875gitlab # [ 10.395433] 8021q: adding VLAN 0 to HW filter on device eth1876gitlab # [ 10.400225] systemd[1]: Finished Extra networking commands..877gitlab # [ 10.401259] systemd[1]: Reached target Network.878gitlab # [ 10.411781] systemd[1]: Starting gitlab-workhorse.service...879gitlab # [ 10.437616] systemd[1]: Starting Nginx Web Server...880gitlab # [ 10.449948] systemd[1]: Starting PostgreSQL Server...881gitlab # [ 10.456111] systemd[1]: Starting Redis Server - redis-gitlab...882gitlab # [ 10.471529] systemd[1]: Starting Permit User Sessions...883gitlab # [ 10.479308] cfg80211: Loading compiled-in X.509 certificates for regulatory database884gitlab # [ 10.486075] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'885gitlab # [ 10.486931] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'886gitlab # [ 10.489075] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2887gitlab # [ 10.489404] cfg80211: failed to load regulatory.db888gitlab # [ 10.495640] systemd-logind[1087]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)889gitlab # [ 10.503212] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.890gitlab # [ 10.508151] systemd[1]: Starting Virtual Console Setup...891gitlab # [ 10.509101] systemd[1]: Finished Permit User Sessions.892gitlab # [ 10.523134] systemd[1]: Started Getty on tty1.893gitlab # [ 10.527191] systemd[1]: Reached target Login Prompts.894gitlab # [ 10.541584] 8021q: adding VLAN 0 to HW filter on device eth0895gitlab # [ 10.541979] dhcpcd[1219]: eth0: waiting for carrier896gitlab # [ 10.543459] dhcpcd[1219]: libudev: received NULL device897gitlab # [ 10.544592] dhcpcd[1219]: libudev: received NULL device898gitlab # [ 10.545560] dhcpcd[1219]: eth0: carrier acquired899gitlab # [ 10.549596] dhcpcd[1219]: DUID 00:01:00:01:31:fb:21:03:52:54:00:12:34:56900gitlab # [ 10.550989] dhcpcd[1219]: eth0: IAID 00:12:34:56901gitlab # [ 10.551934] dhcpcd[1219]: eth0: adding address fe80::5054:ff:fe12:3456902gitlab # [ 10.589580] systemd-vconsole-setup[1244]: Configuration of first virtual console was skipped, ignoring remaining ones.903gitlab # [ 10.601723] systemd[1]: Finished Virtual Console Setup.904gitlab # [ 10.679383] nginx-pre-start[1268]: nginx: the configuration file /nix/store/2526shpjv0bzachwf4qi968gxiiyv4kq-nginx.conf syntax is ok905gitlab # [ 10.682187] nginx-pre-start[1268]: nginx: configuration file /nix/store/2526shpjv0bzachwf4qi968gxiiyv4kq-nginx.conf test is successful906gitlab # [ 10.687254] postgresql-pre-start[1269]: The files belonging to this database system will be owned by user "postgres".907gitlab # [ 10.693786] postgresql-pre-start[1269]: This user must also own the server process.908gitlab # [ 10.695545] systemd[1]: Started Nginx Web Server.909gitlab # [ 10.696949] redis-server[1265]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.910gitlab # [ 10.699595] postgresql-pre-start[1269]: The database cluster will be initialized with locale "en_US.UTF-8".911gitlab # [ 10.701255] postgresql-pre-start[1269]: The default database encoding has accordingly been set to "UTF8".912gitlab # [ 10.702754] postgresql-pre-start[1269]: The default text search configuration will be set to "english".913gitlab # [ 10.704361] postgresql-pre-start[1269]: Data page checksums are disabled.914gitlab # [ 10.705727] postgresql-pre-start[1269]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok915gitlab # [ 10.707471] postgresql-pre-start[1269]: creating subdirectories ... ok916gitlab # [ 10.708779] postgresql-pre-start[1269]: selecting dynamic shared memory implementation ... posix917gitlab # [ 10.710206] redis-server[1265]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo918gitlab # [ 10.711421] systemd[1]: Started Redis Server - redis-gitlab.919gitlab # [ 10.712360] redis-server[1265]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1265, just started920gitlab # [ 10.714241] redis-server[1265]: Configuration loaded921gitlab # [ 10.715120] redis[1265]: monotonic clock: ARM CNTVCT @ 1000 ticks/us922gitlab # [ 10.716232] redis[1265]: Running mode=standalone, port=0.923gitlab # [ 10.717422] redis[1265]: Server initialized924gitlab # [ 10.718261] redis[1265]: Ready to accept connections unix925gitlab # [ 10.719143] redis[1265]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.926gitlab # [ 10.732549] postgresql-pre-start[1269]: selecting default "max_connections" ... 100927gitlab # [ 10.778221] postgresql-pre-start[1269]: selecting default "shared_buffers" ... 128MB928gitlab # [ 11.033155] systemd[1]: Started gitlab-workhorse.service.929gitlab # [ 11.239210] postgresql-pre-start[1269]: selecting default time zone ... UTC930gitlab # [ 11.243734] postgresql-pre-start[1269]: creating configuration files ... ok931gitlab # [ 11.515946] gitlab-workhorse[1293]: time="2026-07-28T08:12:52Z" level=info msg=Starting build_time=19700101.000000 version=18.11.4932gitlab # [ 11.520800] gitlab-workhorse[1293]: time="2026-07-28T08:12:52Z" level=info msg="Using redis/go-redis"933gitlab # [ 11.524741] gitlab-workhorse[1293]: time="2026-07-28T08:12:52Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix934gitlab # [ 11.530417] postgresql-pre-start[1269]: running bootstrap script ... ok935gitlab # [ 12.170798] postgresql-pre-start[1269]: performing post-bootstrap initialization ... ok936gitlab # [ 12.301143] dhcpcd[1219]: eth0: soliciting a DHCP lease937gitlab # [ 12.316976] dhcpcd[1219]: eth0: offered 10.0.2.15 from 10.0.2.2938gitlab # [ 12.324639] dhcpcd[1219]: eth0: probing address 10.0.2.15/24939gitlab # [ 12.416049] dhcpcd[1219]: eth0: soliciting an IPv6 router940gitlab # [ 12.419138] dhcpcd[1219]: eth0: Router Advertisement from fe80::2941gitlab # [ 12.423299] dhcpcd[1219]: eth0: adding address fec0::5054:ff:fe12:3456/64942gitlab # [ 12.427681] dhcpcd[1219]: eth0: adding route to fec0::/64943gitlab # [ 12.431162] dhcpcd[1219]: eth0: adding default route via fe80::2944gitlab # [ 12.492060] postgresql-pre-start[1269]: syncing data to disk ... ok945gitlab # [ 12.494815] postgresql-pre-start[1269]: initdb: warning: enabling "trust" authentication for local connections946gitlab # [ 12.499139] postgresql-pre-start[1269]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.947gitlab # [ 12.505864] postgresql-pre-start[1269]: Success. You can now start the database server using:948gitlab # [ 12.509485] postgresql-pre-start[1269]: pg_ctl -D /var/lib/postgresql/17 -l logfile start949gitlab # [ 12.706786] postgres[1327]: [1327] LOG: starting PostgreSQL 17.10 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit950gitlab # [ 12.713577] postgres[1327]: [1327] LOG: listening on IPv6 address "::1", port 5432951gitlab # [ 12.718347] postgres[1327]: [1327] LOG: listening on IPv4 address "127.0.0.1", port 5432952gitlab # [ 12.723086] postgres[1327]: [1327] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"953gitlab # [ 12.725366] postgres[1338]: [1338] LOG: database system was shut down at 2026-07-28 08:12:53 GMT954gitlab # [ 12.731352] postgres[1327]: [1327] LOG: database system is ready to accept connections955gitlab # [ 12.735714] systemd[1]: Started PostgreSQL Server.956gitlab # [ 12.741231] systemd[1]: Starting PostgreSQL Setup Scripts...957gitlab # [ 12.964126] c0sj6d459nhf3wg9pm6ziy71l4581qq8-gitlab-config[1334]: mkdir -p /var/gitlab/state/home/.ssh: OK958gitlab # [ 12.968582] c0sj6d459nhf3wg9pm6ziy71l4581qq8-gitlab-config[1334]: chmod 700 /var/gitlab/state/home/.ssh: OK959gitlab # [ 13.052992] postgresql-setup-start[1349]: CREATE DATABASE960gitlab # [ 13.091943] systemd[1]: Finished gitlab-config.service.961gitlab # [ 13.098135] systemd[1]: Started gitaly.service.962gitlab # [ 13.108538] postgresql-setup-start[1365]: CREATE ROLE963gitlab # [ 13.135969] postgresql-setup-start[1369]: ALTER DATABASE964gitlab # [ 13.193719] postgresql-setup-start[1375]: CREATE ROLE965gitlab # [ 13.196864] systemd[1]: Finished PostgreSQL Setup Scripts.966gitlab # [ 13.199535] systemd[1]: Reached target PostgreSQL.967gitlab # [ 13.206624] systemd[1]: Starting gitlab-db-config.service...968gitlab # [ 13.212409] systemd[1]: Starting gitlab-postgresql.service...969gitlab # [ 13.419322] gitlab-postgresql-start[1389]: CREATE DATABASE970gitlab # [ 13.485351] gitlab-postgresql-start[1404]: CREATE EXTENSION971gitlab # [ 13.560147] gitlab-postgresql-start[1406]: CREATE EXTENSION972gitlab # [ 13.565857] systemd[1]: Finished gitlab-postgresql.service.973gitlab # [ 13.886368] gitaly[1368]: time="2026-07-28T08:12:54.763Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/krygc3bmd623znp2pddh3fv21q5f3nz2-gitaly.toml' and fix the errors that are printed." pid=1368974gitlab # [ 13.897680] gitaly[1368]: time="2026-07-28T08:12:54.763Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=1368975gitlab # [ 13.902781] gitaly[1368]: time="2026-07-28T08:12:54.763Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=1368976gitlab # [ 13.909417] gitaly[1368]: time="2026-07-28T08:12:54.763Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=1368977gitlab # [ 13.915156] gitaly[1368]: time="2026-07-28T08:12:54.763Z" level=info msg="Starting Gitaly" pid=1368 version=18.11.4978gitlab # [ 14.135108] gitaly[1368]: time="2026-07-28T08:12:55.012Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=248 pid=1368979gitlab # [ 14.138866] gitaly[1368]: time="2026-07-28T08:12:55.014Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=1368980gitlab # [ 14.141961] gitaly[1368]: time="2026-07-28T08:12:55.014Z" level=info msg="finished initializing command factory" duration_ms=0 pid=1368981gitlab # [ 14.144825] gitaly[1368]: time="2026-07-28T08:12:55.014Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1368/git-exec-3572874883.d/git pid=1368982gitlab # [ 14.148497] gitaly[1368]: time="2026-07-28T08:12:55.020Z" level=info msg="finished detecting git version" duration_ms=6 pid=1368983gitlab # [ 14.151554] gitaly[1368]: time="2026-07-28T08:12:55.021Z" level=info msg="using Git version" pid=1368 version=2.53.g984gitlab # [ 14.154502] gitaly[1368]: time="2026-07-28T08:12:55.021Z" level=info msg="clearing disk cache object folder" pid=1368 storage=default985gitlab # [ 14.157911] gitaly[1368]: time="2026-07-28T08:12:55.022Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4180612296 pid=1368 storage=default986gitlab # [ 14.163193] gitaly[1368]: time="2026-07-28T08:12:55.022Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4180612296 pid=1368 storage=default987gitlab # [ 14.169729] gitaly[1368]: time="2026-07-28T08:12:55.022Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=1368988gitlab # [ 14.176741] gitaly[1368]: time="2026-07-28T08:12:55.022Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=1368989gitlab # [ 14.182444] gitaly[1368]: time="2026-07-28T08:12:55.022Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4180612296 clear_duration_ms=0 pid=1368 storage=default990gitlab # [ 14.190417] gitaly[1368]: time="2026-07-28T08:12:55.067Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=1368991gitlab # [ 14.193204] gitaly[1368]: time="2026-07-28T08:12:55.068Z" level=info msg="counting repositories" pid=1368992gitlab # [ 14.194808] gitaly[1368]: time="2026-07-28T08:12:55.068Z" level=info msg="starting to count repositories" pid=1368 storage_path=/var/gitlab/state/repositories993gitlab # [ 14.197475] gitaly[1368]: time="2026-07-28T08:12:55.068Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1368 schema=unix994gitlab # [ 14.200064] gitaly[1368]: time="2026-07-28T08:12:55.068Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1368/sock.d/intern pid=1368 schema=unix995gitlab # [ 14.202708] gitaly[1368]: time="2026-07-28T08:12:55.068Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1368 storage_path=/var/gitlab/state/repositories996gitlab # [ 14.205970] gitaly[1368]: time="2026-07-28T08:12:55.068Z" level=info msg="completed counting all repositories" counting_duration=0 pid=1368997gitlab # [ 14.208287] gitaly[1368]: time="2026-07-28T08:12:55.068Z" level=info msg="finished tempdir cleaner walk" pid=1368 storage=default time_ms=0998gitlab # [ 14.210499] gitaly[1368]: time="2026-07-28T08:12:55.070Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=1368999gitlab # [ 14.212839] gitaly[1368]: time="2026-07-28T08:12:55.070Z" level=info msg="Started Gitaly" duration_ms=307 pid=13681000gitlab # [ 14.214732] gitaly[1368]: time="2026-07-28T08:12:55.071Z" level=info msg="maintenance: daily scheduled" pid=1368 scheduled="2026-07-28 12:00:00 +0000 UTC"1001gitlab # [ 14.559870] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1382]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1002gitlab # [ 14.562847] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1382]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1003gitlab # [ 14.586639] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1382]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1004gitlab # [ 17.286489] dhcpcd[1219]: eth0: leased 10.0.2.15 for 86400 seconds1005gitlab # [ 17.289438] dhcpcd[1219]: eth0: adding route to 10.0.2.0/241006gitlab # [ 17.291941] dhcpcd[1219]: eth0: adding default route via 10.0.2.21007gitlab # [ 17.469087] systemd[1]: Started DHCP Client.1008gitlab # [ 17.473091] systemd[1]: Reached target Network is Online.1009gitlab # [ 17.709598] gitaly[1368]: time="2026-07-28T08:12:58.586Z" level=info msg="License database preloaded" duration_ms=3822 pid=13681010gitlab # [ 60.294126] postgres[1867]: [1867] ERROR: relation "feature_gates" does not exist at character 5231011gitlab # [ 60.294467] postgres[1867]: [1867] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1012gitlab # [ 60.294512] postgres[1867]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1013gitlab # [ 60.294550] postgres[1867]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1014gitlab # [ 60.294597] postgres[1867]: attidentity AS identity,1015gitlab # [ 60.294633] postgres[1867]: attgenerated as attgenerated1016gitlab # [ 60.294669] postgres[1867]: FROM pg_attribute a1017gitlab # [ 60.294706] postgres[1867]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1018gitlab # [ 60.294747] postgres[1867]: LEFT JOIN pg_type t ON a.atttypid = t.oid1019gitlab # [ 60.294783] postgres[1867]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1020gitlab # [ 60.294814] postgres[1867]: WHERE a.attrelid = '"feature_gates"'::regclass1021gitlab # [ 60.294855] postgres[1867]: AND a.attnum > 0 AND NOT a.attisdropped1022gitlab # [ 60.294892] postgres[1867]: ORDER BY a.attnum1023gitlab # [ 60.294927] postgres[1867]:1024gitlab # [ 60.632046] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1382]: W, [2026-07-28T08:13:41.508546 #1382] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1025gitlab # [ 61.603118] gitlab-workhorse[1293]: time="2026-07-28T08:13:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1026gitlab # [ 69.077781] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1953]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1027gitlab # [ 69.084240] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1953]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1028gitlab # [ 71.610442] gitlab-workhorse[1293]: time="2026-07-28T08:13:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1029gitlab # [ 81.611702] gitlab-workhorse[1293]: time="2026-07-28T08:14:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1030gitlab # [ 91.618438] gitlab-workhorse[1293]: time="2026-07-28T08:14:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1031gitlab # [ 94.877239] postgres[2053]: [2053] ERROR: relation "table_without_models" does not exist1032gitlab # [ 94.877647] postgres[2053]: [2053] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1033gitlab # [ 101.628838] gitlab-workhorse[1293]: time="2026-07-28T08:14:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1034gitlab # [ 111.638038] gitlab-workhorse[1293]: time="2026-07-28T08:14:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 121.648343] gitlab-workhorse[1293]: time="2026-07-28T08:14:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 127.431779] systemd[1]: Finished gitlab-db-config.service.1037gitlab # [ 127.437370] systemd[1]: Started gitlab-sidekiq.service.1038gitlab # [ 127.442877] systemd[1]: Starting gitlab.service...1039gitlab # [ 127.937577] bundle[2446]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1040gitlab # [ 127.944076] bundle[2446]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1041gitlab # [ 127.950065] bundle[2446]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1042gitlab # [ 131.658221] gitlab-workhorse[1293]: time="2026-07-28T08:14:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 132.879000] sidekiq-cluster[2445]: {"severity":"INFO","time":"2026-07-28T08:14:53.722Z","message":"Starting cluster with 1 processes"}1044gitlab # [ 132.929967] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.773Z","pid":2446,"message":"* Enabling systemd notification integration"}1045gitlab # [ 132.935077] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.806Z","pid":2446,"message":"Puma starting in cluster mode..."}1046gitlab # [ 132.940119] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.806Z","pid":2446,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1047gitlab # [ 132.944987] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.807Z","pid":2446,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1048gitlab # [ 132.951018] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.807Z","pid":2446,"message":"* Min threads: 0"}1049gitlab # [ 132.955707] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.807Z","pid":2446,"message":"* Max threads: 4"}1050gitlab # [ 132.960588] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.807Z","pid":2446,"message":"* Environment: production"}1051gitlab # [ 132.965003] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.807Z","pid":2446,"message":"* Master PID: 2446"}1052gitlab # [ 132.969494] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.807Z","pid":2446,"message":"* Workers: 2"}1053gitlab # [ 132.973879] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.807Z","pid":2446,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1054gitlab # [ 132.979374] bundle[2446]: {"timestamp":"2026-07-28T08:14:53.807Z","pid":2446,"message":"* Preloading application"}1055gitlab # [ 141.669121] gitlab-workhorse[1293]: time="2026-07-28T08:15:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1056gitlab # [ 151.677259] gitlab-workhorse[1293]: time="2026-07-28T08:15:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1057gitlab # [ 161.688205] gitlab-workhorse[1293]: time="2026-07-28T08:15:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1058gitlab # [ 171.698659] gitlab-workhorse[1293]: time="2026-07-28T08:15:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1059gitlab # [ 181.699949] gitlab-workhorse[1293]: time="2026-07-28T08:15:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1060gitlab # [ 186.087490] bundle[2446]: W, [2026-07-28T08:15:46.964059 #2446] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1061gitlab # [ 191.701604] gitlab-workhorse[1293]: time="2026-07-28T08:15:52Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 193.380503] sidekiq-cluster[2497]: 2026-07-28T08:15:54.257Z pid=2497 tid=top INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2497, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>450154496}1063gitlab # [ 193.830308] sidekiq-cluster[2497]: W, [2026-07-28T08:15:54.707951 #2497] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1064gitlab # [ 193.907000] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:54.784Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1065gitlab # [ 198.378893] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.255Z","message":"GitLab reliable fetch activated!"}1066gitlab # [ 198.379157] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.256Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1067gitlab # [ 198.432108] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.309Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1068gitlab # [ 198.437636] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.315Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1069gitlab # [ 198.443226] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.320Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1070gitlab # [ 198.447713] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.325Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1071gitlab # [ 198.452225] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.329Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1072gitlab # [ 198.456109] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.333Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1073gitlab # [ 198.458952] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.336Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1074gitlab # [ 198.463446] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.341Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1075gitlab # [ 198.469346] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.347Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1076gitlab # [ 198.475417] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.353Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1077gitlab # [ 198.481832] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.359Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1078gitlab # [ 198.486923] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.364Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1079gitlab # [ 198.493732] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.371Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1080gitlab # [ 198.500313] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.377Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1081gitlab # [ 198.515508] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.393Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1082gitlab # [ 198.520871] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.398Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1083gitlab # [ 198.526680] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.404Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1084gitlab # [ 198.534792] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.412Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1085gitlab # [ 198.539644] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.417Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1086gitlab # [ 198.544874] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.422Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1087gitlab # [ 198.551736] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.429Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1088gitlab # [ 198.558508] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.436Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1089gitlab # [ 198.564032] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.441Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1090gitlab # [ 198.568317] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.446Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1091gitlab # [ 198.571627] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.449Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1092gitlab # [ 198.574998] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.452Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1093gitlab # [ 198.578269] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.456Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1094gitlab # [ 198.581674] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.459Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1095gitlab # [ 198.588358] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.463Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1096gitlab # [ 198.590835] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.467Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1097gitlab # [ 198.593221] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.470Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1098gitlab # [ 198.597502] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.475Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1099gitlab # [ 198.605442] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.482Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1100gitlab # [ 198.612128] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.489Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1101gitlab # [ 198.617734] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.495Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1102gitlab # [ 198.621747] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.499Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1103gitlab # [ 198.624982] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.502Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1104gitlab # [ 198.628082] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.505Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1105gitlab # [ 198.631022] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.508Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1106gitlab # [ 198.633950] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.510Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1107gitlab # [ 198.636340] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.513Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1108gitlab # [ 198.639425] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.515Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1109gitlab # [ 198.642618] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.519Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1110gitlab # [ 198.645728] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.523Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1111gitlab # [ 198.648634] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.526Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1112gitlab # [ 198.653508] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.531Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1113gitlab # [ 198.656879] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.534Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1114gitlab # [ 198.659992] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.537Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1115gitlab # [ 198.663059] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.540Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1116gitlab # [ 198.667171] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.544Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1117gitlab # [ 198.669931] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.547Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1118gitlab # [ 198.673325] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.551Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1119gitlab # [ 198.677658] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.555Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1120gitlab # [ 198.766814] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.644Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1121gitlab # [ 198.771593] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.649Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1122gitlab # [ 198.775796] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.653Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1123gitlab # [ 198.781499] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.659Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1124gitlab # [ 198.786733] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.664Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1125gitlab # [ 198.790083] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.667Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1126gitlab # [ 198.794562] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.672Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1127gitlab # [ 198.797164] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.674Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1128gitlab # [ 198.801874] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.679Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1129gitlab # [ 198.805237] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.683Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1130gitlab # [ 198.810720] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.688Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1131gitlab # [ 198.814847] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.692Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1132gitlab # [ 198.821099] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.698Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1133gitlab # [ 198.824619] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.702Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1134gitlab # [ 198.829516] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.707Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1135gitlab # [ 198.831867] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.709Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1136gitlab # [ 198.834958] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.712Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1137gitlab # [ 198.837507] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.715Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1138gitlab # [ 198.839712] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.717Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1139gitlab # [ 198.842888] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.720Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1140gitlab # [ 198.845332] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.723Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1141gitlab # [ 198.848065] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.725Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1142gitlab # [ 198.851334] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.729Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1143gitlab # [ 198.854255] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.731Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1144gitlab # [ 198.857182] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.734Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1145gitlab # [ 198.860088] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.737Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1146gitlab # [ 198.863408] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.741Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1147gitlab # [ 198.865997] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.743Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1148gitlab # [ 198.870006] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.745Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1149gitlab # [ 198.872719] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.748Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1150gitlab # [ 198.875264] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.752Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1151gitlab # [ 198.878545] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.756Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1152gitlab # [ 198.881456] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.759Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1153gitlab # [ 198.885225] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.763Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1154gitlab # [ 198.888543] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.766Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1155gitlab # [ 198.893641] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.770Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1156gitlab # [ 198.896573] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.774Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1157gitlab # [ 198.898983] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.776Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1158gitlab # [ 198.901529] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.778Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1159gitlab # [ 198.903815] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.781Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1160gitlab # [ 198.907048] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.784Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1161gitlab # [ 198.910211] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.787Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1162gitlab # [ 198.914345] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.792Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1163gitlab # [ 198.917828] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.795Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1164gitlab # [ 198.922028] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.799Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1165gitlab # [ 198.924771] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.802Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1166gitlab # [ 198.936947] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.814Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1167gitlab # [ 198.939816] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.817Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1168gitlab # [ 198.942359] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.819Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1169gitlab # [ 198.946855] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.824Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1170gitlab # [ 198.950684] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.828Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1171gitlab # [ 198.953976] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.831Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1172gitlab # [ 198.957676] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.835Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1173gitlab # [ 198.960210] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.838Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1174gitlab # [ 198.963175] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.840Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1175gitlab # [ 198.967113] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.844Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1176gitlab # [ 198.969511] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:15:59.847Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1177gitlab # [ 201.711607] gitlab-workhorse[1293]: time="2026-07-28T08:16:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1178gitlab # [ 211.713129] gitlab-workhorse[1293]: time="2026-07-28T08:16:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1179gitlab # [ 221.722869] gitlab-workhorse[1293]: time="2026-07-28T08:16:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1180gitlab # [ 231.734464] gitlab-workhorse[1293]: time="2026-07-28T08:16:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 241.742672] gitlab-workhorse[1293]: time="2026-07-28T08:16:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 251.649251] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:16:52.525Z","message":"Booted Rails 7.2.3 application in production environment"}1183gitlab # [ 251.649654] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:16:52.525Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1184gitlab # [ 251.649866] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:16:52.525Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1185gitlab # [ 251.650060] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:16:52.525Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1186gitlab # [ 251.651244] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:16:52.528Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1187gitlab # [ 251.743674] gitlab-workhorse[1293]: time="2026-07-28T08:16:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 253.338224] bundle[2446]: {"timestamp":"2026-07-28T08:16:54.213Z","pid":2446,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1189gitlab # [ 253.344759] bundle[2446]: {"timestamp":"2026-07-28T08:16:54.214Z","pid":2446,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1190gitlab # [ 253.350192] bundle[2446]: {"timestamp":"2026-07-28T08:16:54.214Z","pid":2446,"message":"! #\u003cThread:0x0000f42aec7c27c8 /nix/store/09wikq0z4z0s8mkafl8f2b6yp0p78frd-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/09wikq0z4z0s8mkafl8f2b6yp0p78frd-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1191gitlab # [ 253.368304] bundle[2446]: {"timestamp":"2026-07-28T08:16:54.214Z","pid":2446,"message":"! #\u003cThread:0x0000f42aeca04cc0 /nix/store/q2bwpwxril8z19gq9b1nnv72drlwhhg8-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/q2bwpwxril8z19gq9b1nnv72drlwhhg8-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1192gitlab # [ 253.384672] bundle[2446]: {"timestamp":"2026-07-28T08:16:54.214Z","pid":2446,"message":"Use Ctrl-C to stop"}1193gitlab # [ 253.389000] bundle[2446]: {"timestamp":"2026-07-28T08:16:54.215Z","pid":2446,"message":"Sending status to systemd every 1.0 sec"}1194gitlab # [ 254.650095] bundle[2446]: {"timestamp":"2026-07-28T08:16:55.526Z","pid":2446,"message":"- Worker 0 (PID: 3551) booted in 1.26s, phase: 0"}1195gitlab # [ 254.651904] bundle[2446]: {"timestamp":"2026-07-28T08:16:55.526Z","pid":2446,"message":"- Worker 1 (PID: 3555) booted in 1.22s, phase: 0"}1196gitlab # [ 254.660487] systemd[1]: Started gitlab.service.1197gitlab # [ 254.663421] systemd[1]: Reached target Common target for all GitLab services..1198gitlab # [ 254.675712] systemd[1]: Starting setup-gitlab.service...1199gitlab # [ 254.732993] setup-gitlab-start[3596]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1200gitlab # [ 255.009594] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:16:55.886Z","message":"Cleaning working queues"}1201gitlab # [ 255.014875] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:16:55.888Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3d1f7d165c7ae258a850b208","created_at":"2026-07-28T08:14:47.230Z","trace_propagation_headers":{"sentry-trace":"1efa5235e1314d77a2c2d5085784ccbd-4edd33b430994cb0","baggage":"sentry-trace_id=1efa5235e1314d77a2c2d5085784ccbd,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"9fb64121ba2e6036cefd6c9e59398da9","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-28T08:14:47.257Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3d1f7d165c7ae258a850b208: start","job_status":"start","queue_duration_s":128.630639,"scheduling_latency_s":128.630707}1202gitlab # [ 255.341429] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:16:56.218Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3d1f7d165c7ae258a850b208","created_at":"2026-07-28T08:14:47.230Z","trace_propagation_headers":{"sentry-trace":"1efa5235e1314d77a2c2d5085784ccbd-4edd33b430994cb0","baggage":"sentry-trace_id=1efa5235e1314d77a2c2d5085784ccbd,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"9fb64121ba2e6036cefd6c9e59398da9","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-28T08:14:47.257Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3d1f7d165c7ae258a850b208: done: 0.329533 sec","job_status":"done","queue_duration_s":128.630639,"scheduling_latency_s":128.630707,"redis_calls":24,"redis_duration_s":0.011029,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005378,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003519,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002132,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.153905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1874686,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.329533,"completed_at":"2026-07-28T08:16:56.217Z","load_balancing_strategy":"primary","db_duration_s":0.118364,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1203gitlab # [ 258.747568] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:16:59 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 39691204gitlab # [ 258.757619] setup-gitlab-start[3628]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1205gitlab # [ 258.760566] setup-gitlab-start[3629]: ++ jq -r .access_token1206gitlab # [ 259.915318] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:17:00 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 11251207gitlab # [ 259.922186] setup-gitlab-start[3596]: + BEARER=f1837b50064f5a7fe1697129ab630dbd44800a1192563705c7a9e750df6b58c51208gitlab # [ 259.922970] setup-gitlab-start[3596]: + AUTH='Authorization: Bearer f1837b50064f5a7fe1697129ab630dbd44800a1192563705c7a9e750df6b58c5'1209gitlab # [ 259.932485] setup-gitlab-start[3596]: + curl -fs -X PUT -H 'Authorization: Bearer f1837b50064f5a7fe1697129ab630dbd44800a1192563705c7a9e750df6b58c5' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1210gitlab # [ 261.563516] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:17:02 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 16231211gitlab # [ 261.568831] setup-gitlab-start[3596]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1212gitlab # [ 261.588595] runuser[3657]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1213gitlab # [ 262.224761] setup-gitlab-start[3658]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1214gitlab # [ 262.225183] setup-gitlab-start[3658]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1215gitlab # [ 262.227325] setup-gitlab-start[3658]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1216gitlab # [ 263.213878] setup-gitlab-start[3658]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 263.214504] setup-gitlab-start[3658]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 263.223425] setup-gitlab-start[3658]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 266.645871] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:07.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ff7ac2143bb5dba2bb123ce0","created_at":"2026-07-28T08:17:07.413Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.517Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ff7ac2143bb5dba2bb123ce0: start","job_status":"start","queue_duration_s":0.004178,"scheduling_latency_s":0.004249}1220gitlab # [ 267.014299] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:07.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ff7ac2143bb5dba2bb123ce0","created_at":"2026-07-28T08:17:07.413Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.517Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ff7ac2143bb5dba2bb123ce0: done: 0.368995 sec","job_status":"done","queue_duration_s":0.004178,"scheduling_latency_s":0.004249,"redis_calls":19,"redis_duration_s":0.087926,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.015728,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001271,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.062627,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.0083,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04673942,"duration_s":0.368995,"completed_at":"2026-07-28T08:17:07.890Z","load_balancing_strategy":"primary","db_duration_s":0.03069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1221gitlab # [ 267.107033] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:07.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6b1adcf0c6bd4f5a522dfe05","created_at":"2026-07-28T08:17:07.541Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f542f2a4b716ba9d8ec37cd98a3fa8e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.563Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6b1adcf0c6bd4f5a522dfe05: start","job_status":"start","queue_duration_s":0.39982,"scheduling_latency_s":0.399896}1222gitlab # [ 267.188813] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:08.066Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1223gitlab # [ 267.236858] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:08.113Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6b1adcf0c6bd4f5a522dfe05","created_at":"2026-07-28T08:17:07.541Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f542f2a4b716ba9d8ec37cd98a3fa8e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.563Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6b1adcf0c6bd4f5a522dfe05: done: 0.150593 sec","job_status":"done","queue_duration_s":0.39982,"scheduling_latency_s":0.399896,"redis_calls":10,"redis_duration_s":0.039887,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.019969,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.012655,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00212756,"duration_s":0.150593,"completed_at":"2026-07-28T08:17:08.113Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 267.305366] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:08.147Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"60a3a2b5ef5cb3d878c80207","created_at":"2026-07-28T08:17:07.576Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86e98524d91059af9cae933ffcfef958","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.605Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-60a3a2b5ef5cb3d878c80207: start","job_status":"start","queue_duration_s":0.541804,"scheduling_latency_s":0.541872}1225gitlab # [ 267.420893] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:08.297Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"60a3a2b5ef5cb3d878c80207","created_at":"2026-07-28T08:17:07.576Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86e98524d91059af9cae933ffcfef958","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.605Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-60a3a2b5ef5cb3d878c80207: done: 0.150537 sec","job_status":"done","queue_duration_s":0.541804,"scheduling_latency_s":0.541872,"redis_calls":13,"redis_duration_s":0.02552,"redis_read_bytes":139,"redis_write_bytes":1552,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.013828,"redis_feature_flag_read_bytes":132,"redis_feature_flag_write_bytes":680,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007689,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00128408,"duration_s":0.150537,"completed_at":"2026-07-28T08:17:08.297Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 267.513899] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:08.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a0cf0987279a83f83a927063","created_at":"2026-07-28T08:17:07.637Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.652Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a0cf0987279a83f83a927063: start","job_status":"start","queue_duration_s":0.661022,"scheduling_latency_s":0.661068}1227gitlab # [ 268.186631] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.062Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"a0cf0987279a83f83a927063","created_at":"2026-07-28T08:17:07.637Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.652Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-a0cf0987279a83f83a927063: done: 0.748645 sec","job_status":"done","queue_duration_s":0.661022,"scheduling_latency_s":0.661068,"redis_calls":71,"redis_duration_s":0.299651,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.020545,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001797,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.271109,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.0062,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.334693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064932,"duration_s":0.748645,"completed_at":"2026-07-28T08:17:09.062Z","load_balancing_strategy":"primary","db_duration_s":0.02256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 268.188169] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"064e184e4c883207f90239fc","created_at":"2026-07-28T08:17:07.682Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f4e4fe07913fc85ab4b788d3892f15c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.695Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-064e184e4c883207f90239fc: start","job_status":"start","queue_duration_s":1.370119,"scheduling_latency_s":1.37016}1229gitlab # [ 268.335414] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"064e184e4c883207f90239fc","created_at":"2026-07-28T08:17:07.682Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f4e4fe07913fc85ab4b788d3892f15c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.695Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-064e184e4c883207f90239fc: done: 0.147005 sec","job_status":"done","queue_duration_s":1.370119,"scheduling_latency_s":1.37016,"redis_calls":10,"redis_duration_s":0.004047,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000758,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002427,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.091,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066502,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.147005,"completed_at":"2026-07-28T08:17:09.212Z","load_balancing_strategy":"primary","db_duration_s":0.096958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 268.399273] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e060c174e0e0c5033deee704","created_at":"2026-07-28T08:17:07.706Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"489d001fa90748e828328b6706be1332","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.732Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e060c174e0e0c5033deee704: start","job_status":"start","queue_duration_s":1.482326,"scheduling_latency_s":1.482364}1231gitlab # [ 268.415587] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.237Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1232gitlab # [ 268.419631] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e060c174e0e0c5033deee704","created_at":"2026-07-28T08:17:07.706Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"489d001fa90748e828328b6706be1332","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.732Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e060c174e0e0c5033deee704: done: 0.036322 sec","job_status":"done","queue_duration_s":1.482326,"scheduling_latency_s":1.482364,"redis_calls":10,"redis_duration_s":0.0037610000000000005,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000698,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002465,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00085496,"duration_s":0.036322,"completed_at":"2026-07-28T08:17:09.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000917,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 268.464293] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.253Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"50bf3b7d4c23623d80497a46","created_at":"2026-07-28T08:17:07.764Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"396884ffc1c609450cfc7e56dcca0798","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.799Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-50bf3b7d4c23623d80497a46: start","job_status":"start","queue_duration_s":1.453834,"scheduling_latency_s":1.453867}1234gitlab # [ 268.733616] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"50bf3b7d4c23623d80497a46","created_at":"2026-07-28T08:17:07.764Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"396884ffc1c609450cfc7e56dcca0798","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.799Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-50bf3b7d4c23623d80497a46: done: 0.357302 sec","job_status":"done","queue_duration_s":1.453834,"scheduling_latency_s":1.453867,"redis_calls":12,"redis_duration_s":0.004232,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00053,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.298001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00134952,"exclusive_lock_hold_duration_s":0.28614444,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.357302,"completed_at":"2026-07-28T08:17:09.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 268.846915] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.612Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8faca40d3c082d1592ad55c6","created_at":"2026-07-28T08:17:07.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b23c8906c96140e9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.805Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8faca40d3c082d1592ad55c6: start","job_status":"start","queue_duration_s":1.807436,"scheduling_latency_s":1.807471}1236gitlab # [ 268.865922] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.641Z","message":"No existing merge request to be cleaned up."}1237gitlab # [ 268.868218] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.665Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8faca40d3c082d1592ad55c6","created_at":"2026-07-28T08:17:07.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b23c8906c96140e9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.805Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8faca40d3c082d1592ad55c6: done: 0.052829 sec","job_status":"done","queue_duration_s":1.807436,"scheduling_latency_s":1.807471,"redis_calls":13,"redis_duration_s":0.004201,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002271,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00079192,"duration_s":0.052829,"completed_at":"2026-07-28T08:17:09.665Z","load_balancing_strategy":"primary","db_duration_s":0.00939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 268.913900] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.667Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b1385a970ae15c7df005d300","created_at":"2026-07-28T08:17:07.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b23c8906c96140e9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.805Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b1385a970ae15c7df005d300: start","job_status":"start","queue_duration_s":1.862233,"scheduling_latency_s":1.862268}1239gitlab # [ 268.926762] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.685Z","message":"No existing merge request to be cleaned up."}1240gitlab # [ 268.928539] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.700Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b1385a970ae15c7df005d300","created_at":"2026-07-28T08:17:07.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b23c8906c96140e9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.805Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b1385a970ae15c7df005d300: done: 0.033095 sec","job_status":"done","queue_duration_s":1.862233,"scheduling_latency_s":1.862268,"redis_calls":10,"redis_duration_s":0.002739,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001468,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033095,"completed_at":"2026-07-28T08:17:09.700Z","load_balancing_strategy":"primary","db_duration_s":0.004132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 268.968316] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.702Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba0bcc68210656119f9105f0","created_at":"2026-07-28T08:17:07.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b23c8906c96140e9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.805Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba0bcc68210656119f9105f0: start","job_status":"start","queue_duration_s":1.897238,"scheduling_latency_s":1.897272}1242gitlab # [ 268.981036] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.719Z","message":"No existing merge request to be cleaned up."}1243gitlab # [ 268.982754] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.733Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba0bcc68210656119f9105f0","created_at":"2026-07-28T08:17:07.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b23c8906c96140e9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.805Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba0bcc68210656119f9105f0: done: 0.031456 sec","job_status":"done","queue_duration_s":1.897238,"scheduling_latency_s":1.897272,"redis_calls":10,"redis_duration_s":0.002519,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001415,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031456,"completed_at":"2026-07-28T08:17:09.733Z","load_balancing_strategy":"primary","db_duration_s":0.003817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 269.023910] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.735Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"eaf6107e7b526e6ad13ce770","created_at":"2026-07-28T08:17:07.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b23c8906c96140e9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.805Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-eaf6107e7b526e6ad13ce770: start","job_status":"start","queue_duration_s":1.930487,"scheduling_latency_s":1.930524}1245gitlab # [ 269.036659] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.753Z","message":"No existing merge request to be cleaned up."}1246gitlab # [ 269.038438] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.768Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"eaf6107e7b526e6ad13ce770","created_at":"2026-07-28T08:17:07.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b23c8906c96140e9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e10139e2ab336bb72f947aabc5306ce7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.805Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-eaf6107e7b526e6ad13ce770: done: 0.032743 sec","job_status":"done","queue_duration_s":1.930487,"scheduling_latency_s":1.930524,"redis_calls":10,"redis_duration_s":0.0032440000000000004,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002096,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032743,"completed_at":"2026-07-28T08:17:09.768Z","load_balancing_strategy":"primary","db_duration_s":0.004178,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 269.078473] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.770Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9ef93e0d7dafc9848a17ea19","created_at":"2026-07-28T08:17:07.863Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"839cbd8379abf08e45027c07e4863dad","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.960Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9ef93e0d7dafc9848a17ea19: start","job_status":"start","queue_duration_s":1.81021,"scheduling_latency_s":1.810246}1248gitlab # [ 269.093746] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9ef93e0d7dafc9848a17ea19","created_at":"2026-07-28T08:17:07.863Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"839cbd8379abf08e45027c07e4863dad","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:07.960Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9ef93e0d7dafc9848a17ea19: done: 0.054856 sec","job_status":"done","queue_duration_s":1.81021,"scheduling_latency_s":1.810246,"redis_calls":13,"redis_duration_s":0.003704,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000563,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001642,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001499,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01943532,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.054856,"completed_at":"2026-07-28T08:17:09.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008317,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1249gitlab # [ 269.139408] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"07ee24697639b097ed645692","created_at":"2026-07-28T08:17:07.985Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d5685935bb3c30df781ece1ab2e3348","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-28T08:17:08.004Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-07ee24697639b097ed645692: start","job_status":"start","queue_duration_s":1.823342,"scheduling_latency_s":1.823408}1250gitlab # [ 269.153387] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.847Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1251gitlab # [ 269.157248] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"07ee24697639b097ed645692","created_at":"2026-07-28T08:17:07.985Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d5685935bb3c30df781ece1ab2e3348","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-28T08:17:08.004Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-07ee24697639b097ed645692: done: 0.029926 sec","job_status":"done","queue_duration_s":1.823342,"scheduling_latency_s":1.823408,"redis_calls":10,"redis_duration_s":0.002794,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000583,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067248,"duration_s":0.029926,"completed_at":"2026-07-28T08:17:09.857Z","load_balancing_strategy":"primary","db_duration_s":0.000956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 269.200198] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"07044a19de6d4c8092bb92e0","created_at":"2026-07-28T08:17:08.033Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e17a31bbec8f4f7d56db48714b5f1a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.069Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-07044a19de6d4c8092bb92e0: start","job_status":"start","queue_duration_s":1.790257,"scheduling_latency_s":1.790292}1253gitlab # [ 269.216277] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.902Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"07044a19de6d4c8092bb92e0","created_at":"2026-07-28T08:17:08.033Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e17a31bbec8f4f7d56db48714b5f1a","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.069Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-07044a19de6d4c8092bb92e0: done: 0.042047 sec","job_status":"done","queue_duration_s":1.790257,"scheduling_latency_s":1.790292,"redis_calls":12,"redis_duration_s":0.003144,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000566,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00092358,"exclusive_lock_hold_duration_s":0.01074806,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.042047,"completed_at":"2026-07-28T08:17:09.901Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 269.261051] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b7a035f3fbda231f14d0c7ff","created_at":"2026-07-28T08:17:08.100Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"579df8066eabb651c9782779fee66db4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.121Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b7a035f3fbda231f14d0c7ff: start","job_status":"start","queue_duration_s":1.782737,"scheduling_latency_s":1.782771}1255gitlab # [ 269.276300] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.934Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b7a035f3fbda231f14d0c7ff","created_at":"2026-07-28T08:17:08.100Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"579df8066eabb651c9782779fee66db4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.121Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b7a035f3fbda231f14d0c7ff: done: 0.029768 sec","job_status":"done","queue_duration_s":1.782737,"scheduling_latency_s":1.782771,"redis_calls":10,"redis_duration_s":0.002479,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036224,"duration_s":0.029768,"completed_at":"2026-07-28T08:17:09.933Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 269.320630] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:09.936Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2d74189fd7cbb4e755def09d","created_at":"2026-07-28T08:17:08.145Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ff1ce86ddf5d285cadb555960c98a28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.203Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2d74189fd7cbb4e755def09d: start","job_status":"start","queue_duration_s":1.732443,"scheduling_latency_s":1.732477}1257gitlab # [ 269.394107] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2d74189fd7cbb4e755def09d","created_at":"2026-07-28T08:17:08.145Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ff1ce86ddf5d285cadb555960c98a28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.203Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2d74189fd7cbb4e755def09d: done: 0.335278 sec","job_status":"done","queue_duration_s":1.732443,"scheduling_latency_s":1.732477,"redis_calls":14,"redis_duration_s":0.003977,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001066,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001527,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001384,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.044,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.282808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00086412,"exclusive_lock_hold_duration_s":0.29780082,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.335278,"completed_at":"2026-07-28T08:17:10.271Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.062595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 269.469022] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.273Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b2260a723ab6d84363363bb8","created_at":"2026-07-28T08:17:08.252Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e13d1cfd76a5326be1c18e6f1118c7f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-28T08:17:08.291Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b2260a723ab6d84363363bb8: start","job_status":"start","queue_duration_s":1.982204,"scheduling_latency_s":1.982234}1259gitlab # [ 269.484394] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.293Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1260gitlab # [ 269.487888] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b2260a723ab6d84363363bb8","created_at":"2026-07-28T08:17:08.252Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e13d1cfd76a5326be1c18e6f1118c7f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-28T08:17:08.291Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b2260a723ab6d84363363bb8: done: 0.030671 sec","job_status":"done","queue_duration_s":1.982204,"scheduling_latency_s":1.982234,"redis_calls":10,"redis_duration_s":0.002467,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000577,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000576,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036934,"duration_s":0.030671,"completed_at":"2026-07-28T08:17:10.304Z","load_balancing_strategy":"primary","db_duration_s":0.001096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1261gitlab # [ 269.531666] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.306Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"27e3fb548ea03f211e1e1df5","created_at":"2026-07-28T08:17:08.311Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b056dec8145902dee131c735c584c728","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.330Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-27e3fb548ea03f211e1e1df5: start","job_status":"start","queue_duration_s":1.976088,"scheduling_latency_s":1.97612}1262gitlab # [ 269.546077] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.349Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"27e3fb548ea03f211e1e1df5","created_at":"2026-07-28T08:17:08.311Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b056dec8145902dee131c735c584c728","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.330Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-27e3fb548ea03f211e1e1df5: done: 0.043019 sec","job_status":"done","queue_duration_s":1.976088,"scheduling_latency_s":1.97612,"redis_calls":10,"redis_duration_s":0.002627,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000614,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001425,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036442,"duration_s":0.043019,"completed_at":"2026-07-28T08:17:10.349Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 269.589596] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.351Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c4abe8a2aa6c0bf979f9517b","created_at":"2026-07-28T08:17:08.358Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d1731deca1eee53774b533b31766ac8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.395Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c4abe8a2aa6c0bf979f9517b: start","job_status":"start","queue_duration_s":1.956782,"scheduling_latency_s":1.956818}1264gitlab # [ 269.603722] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.400Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c4abe8a2aa6c0bf979f9517b","created_at":"2026-07-28T08:17:08.358Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d1731deca1eee53774b533b31766ac8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.395Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c4abe8a2aa6c0bf979f9517b: done: 0.04916 sec","job_status":"done","queue_duration_s":1.956782,"scheduling_latency_s":1.956818,"redis_calls":12,"redis_duration_s":0.003667,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001393,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0009377,"exclusive_lock_hold_duration_s":0.01381846,"duration_s":0.04916,"completed_at":"2026-07-28T08:17:10.400Z","load_balancing_strategy":"primary","db_duration_s":0.010246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 269.648015] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e2d17d0c2de8c45765e5fbf4","created_at":"2026-07-28T08:17:08.421Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9446200fa54540cc3058ea16312b126e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-28T08:17:08.460Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e2d17d0c2de8c45765e5fbf4: start","job_status":"start","queue_duration_s":1.942969,"scheduling_latency_s":1.943001}1266gitlab # [ 269.661658] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.455Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e2d17d0c2de8c45765e5fbf4","created_at":"2026-07-28T08:17:08.421Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9446200fa54540cc3058ea16312b126e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-28T08:17:08.460Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e2d17d0c2de8c45765e5fbf4: done: 0.052755 sec","job_status":"done","queue_duration_s":1.942969,"scheduling_latency_s":1.943001,"redis_calls":10,"redis_duration_s":0.0026750000000000003,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000514,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001567,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000594,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037036,"duration_s":0.052755,"completed_at":"2026-07-28T08:17:10.455Z","load_balancing_strategy":"primary","db_duration_s":0.008373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 269.704395] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.457Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"84ba4b66c72c3405e9e95ad9","created_at":"2026-07-28T08:17:08.503Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b11216cb1e0d51c67a3a5760ba5ed745","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.535Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-84ba4b66c72c3405e9e95ad9: start","job_status":"start","queue_duration_s":1.921943,"scheduling_latency_s":1.921977}1268gitlab # [ 269.719044] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.517Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"84ba4b66c72c3405e9e95ad9","created_at":"2026-07-28T08:17:08.503Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b11216cb1e0d51c67a3a5760ba5ed745","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.535Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-84ba4b66c72c3405e9e95ad9: done: 0.060108 sec","job_status":"done","queue_duration_s":1.921943,"scheduling_latency_s":1.921977,"redis_calls":16,"redis_duration_s":0.00444,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002366,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001386,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037402,"duration_s":0.060108,"completed_at":"2026-07-28T08:17:10.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 269.762830] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:10.519Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8294798195b031604144460f","created_at":"2026-07-28T08:17:08.571Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64fe47c78d82cd9ef03d168710d632b6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.604Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8294798195b031604144460f: start","job_status":"start","queue_duration_s":1.915718,"scheduling_latency_s":1.915753}1270gitlab # [ 270.158487] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.035Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8294798195b031604144460f","created_at":"2026-07-28T08:17:08.571Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64fe47c78d82cd9ef03d168710d632b6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.604Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8294798195b031604144460f: done: 0.51558 sec","job_status":"done","queue_duration_s":1.915718,"scheduling_latency_s":1.915753,"redis_calls":574,"redis_duration_s":0.149456,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000813,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001613,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.14703,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.420678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043652,"duration_s":0.51558,"completed_at":"2026-07-28T08:17:11.035Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 270.267518] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5cda85bdaa26fedf2a7a60aa","created_at":"2026-07-28T08:17:08.638Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7ce10c3d48271b90ddcf5cbf609e601","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.673Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5cda85bdaa26fedf2a7a60aa: start","job_status":"start","queue_duration_s":2.364643,"scheduling_latency_s":2.364676}1272gitlab # [ 270.291748] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.056Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1273gitlab # [ 270.296410] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5cda85bdaa26fedf2a7a60aa","created_at":"2026-07-28T08:17:08.638Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7ce10c3d48271b90ddcf5cbf609e601","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.673Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5cda85bdaa26fedf2a7a60aa: done: 0.028857 sec","job_status":"done","queue_duration_s":2.364643,"scheduling_latency_s":2.364676,"redis_calls":10,"redis_duration_s":0.0035450000000000004,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000807,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002047,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045788,"duration_s":0.028857,"completed_at":"2026-07-28T08:17:11.066Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 270.344966] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.069Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"42e51f19f4874bf57c070984","created_at":"2026-07-28T08:17:08.713Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6434049700679695be83c4686e1795aa","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.745Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-42e51f19f4874bf57c070984: start","job_status":"start","queue_duration_s":2.324272,"scheduling_latency_s":2.324308}1275gitlab # [ 270.359249] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"42e51f19f4874bf57c070984","created_at":"2026-07-28T08:17:08.713Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6434049700679695be83c4686e1795aa","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.745Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-42e51f19f4874bf57c070984: done: 0.080426 sec","job_status":"done","queue_duration_s":2.324272,"scheduling_latency_s":2.324308,"redis_calls":12,"redis_duration_s":0.005138,"redis_read_bytes":11,"redis_write_bytes":1354,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00084,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":297,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001927,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":519,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00092518,"exclusive_lock_hold_duration_s":0.0478603,"duration_s":0.080426,"completed_at":"2026-07-28T08:17:11.149Z","load_balancing_strategy":"primary","db_duration_s":0.034401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 270.402298] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"049dbcddbe5d9dff4705fcc8","created_at":"2026-07-28T08:17:08.781Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"152ecc09d1e3460db85512b843b84cbd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.813Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-049dbcddbe5d9dff4705fcc8: start","job_status":"start","queue_duration_s":2.33939,"scheduling_latency_s":2.339426}1277gitlab # [ 270.417714] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.225Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"049dbcddbe5d9dff4705fcc8","created_at":"2026-07-28T08:17:08.781Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"152ecc09d1e3460db85512b843b84cbd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.813Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-049dbcddbe5d9dff4705fcc8: done: 0.0727 sec","job_status":"done","queue_duration_s":2.33939,"scheduling_latency_s":2.339426,"redis_calls":12,"redis_duration_s":0.004997,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000833,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00197,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00098874,"exclusive_lock_hold_duration_s":0.03759624,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.0727,"completed_at":"2026-07-28T08:17:11.225Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 270.466508] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.228Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2cde2286485c1f87df456b89","created_at":"2026-07-28T08:17:08.851Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c047d1a4914b940b254065d4c564d61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.884Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2cde2286485c1f87df456b89: start","job_status":"start","queue_duration_s":2.343682,"scheduling_latency_s":2.343718}1279gitlab # [ 270.482852] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.249Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1280gitlab # [ 270.486820] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.259Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2cde2286485c1f87df456b89","created_at":"2026-07-28T08:17:08.851Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c047d1a4914b940b254065d4c564d61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-28T08:17:08.884Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2cde2286485c1f87df456b89: done: 0.031375 sec","job_status":"done","queue_duration_s":2.343682,"scheduling_latency_s":2.343718,"redis_calls":10,"redis_duration_s":0.003547,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000788,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002035,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004531,"duration_s":0.031375,"completed_at":"2026-07-28T08:17:11.259Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 270.531608] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"689a04fb3dec4158c741d4c2","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-689a04fb3dec4158c741d4c2: start","job_status":"start","queue_duration_s":2.218699,"scheduling_latency_s":2.218731}1282gitlab # [ 270.544656] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"689a04fb3dec4158c741d4c2","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-689a04fb3dec4158c741d4c2: done: 0.034028 sec","job_status":"done","queue_duration_s":2.218699,"scheduling_latency_s":2.218731,"redis_calls":16,"redis_duration_s":0.005473,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000787,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003194,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042902,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034028,"completed_at":"2026-07-28T08:17:11.295Z","load_balancing_strategy":"primary","db_duration_s":0.001006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 270.586851] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e46cb69567e9c7ea8d8ed28","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e46cb69567e9c7ea8d8ed28: start","job_status":"start","queue_duration_s":2.255129,"scheduling_latency_s":2.255163}1284gitlab # [ 270.599976] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e46cb69567e9c7ea8d8ed28","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e46cb69567e9c7ea8d8ed28: done: 0.02228 sec","job_status":"done","queue_duration_s":2.255129,"scheduling_latency_s":2.255163,"redis_calls":13,"redis_duration_s":0.003778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002227,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02228,"completed_at":"2026-07-28T08:17:11.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 270.641959] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"506dda15efa809b33cc5ce04","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-506dda15efa809b33cc5ce04: start","job_status":"start","queue_duration_s":2.279456,"scheduling_latency_s":2.279489}1286gitlab # [ 270.654752] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"506dda15efa809b33cc5ce04","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-506dda15efa809b33cc5ce04: done: 0.022266 sec","job_status":"done","queue_duration_s":2.279456,"scheduling_latency_s":2.279489,"redis_calls":13,"redis_duration_s":0.00366,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001204,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002456,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022266,"completed_at":"2026-07-28T08:17:11.344Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 270.695407] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"782ada2f23514aa46874bc90","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-782ada2f23514aa46874bc90: start","job_status":"start","queue_duration_s":2.303733,"scheduling_latency_s":2.303764}1288gitlab # [ 270.708551] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"782ada2f23514aa46874bc90","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-782ada2f23514aa46874bc90: done: 0.022431 sec","job_status":"done","queue_duration_s":2.303733,"scheduling_latency_s":2.303764,"redis_calls":13,"redis_duration_s":0.003833,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002643,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022431,"completed_at":"2026-07-28T08:17:11.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 270.750562] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"709ff4c0b98c710655c9e911","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-709ff4c0b98c710655c9e911: start","job_status":"start","queue_duration_s":2.328936,"scheduling_latency_s":2.32897}1290gitlab # [ 270.763711] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"709ff4c0b98c710655c9e911","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-709ff4c0b98c710655c9e911: done: 0.025621 sec","job_status":"done","queue_duration_s":2.328936,"scheduling_latency_s":2.32897,"redis_calls":13,"redis_duration_s":0.0058969999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025621,"completed_at":"2026-07-28T08:17:11.397Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 270.804715] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd0300b0ae880125edf67753","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd0300b0ae880125edf67753: start","job_status":"start","queue_duration_s":2.356519,"scheduling_latency_s":2.35655}1292gitlab # [ 270.817478] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd0300b0ae880125edf67753","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd0300b0ae880125edf67753: done: 0.026418 sec","job_status":"done","queue_duration_s":2.356519,"scheduling_latency_s":2.35655,"redis_calls":13,"redis_duration_s":0.005568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026418,"completed_at":"2026-07-28T08:17:11.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 270.859198] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e7fd32144c94b45c532c798","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e7fd32144c94b45c532c798: start","job_status":"start","queue_duration_s":2.385217,"scheduling_latency_s":2.385251}1294gitlab # [ 270.872266] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e7fd32144c94b45c532c798","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e7fd32144c94b45c532c798: done: 0.02439 sec","job_status":"done","queue_duration_s":2.385217,"scheduling_latency_s":2.385251,"redis_calls":13,"redis_duration_s":0.004413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02439,"completed_at":"2026-07-28T08:17:11.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 270.912473] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49a72d4fa63fc8baa28fff11","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49a72d4fa63fc8baa28fff11: start","job_status":"start","queue_duration_s":2.411977,"scheduling_latency_s":2.412013}1296gitlab # [ 270.925252] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49a72d4fa63fc8baa28fff11","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49a72d4fa63fc8baa28fff11: done: 0.023897 sec","job_status":"done","queue_duration_s":2.411977,"scheduling_latency_s":2.412013,"redis_calls":13,"redis_duration_s":0.003036,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00135,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001686,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023897,"completed_at":"2026-07-28T08:17:11.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 270.965336] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6fefbde6887c81372065c97","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6fefbde6887c81372065c97: start","job_status":"start","queue_duration_s":2.437898,"scheduling_latency_s":2.437931}1298gitlab # [ 270.978217] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6fefbde6887c81372065c97","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6fefbde6887c81372065c97: done: 0.018987 sec","job_status":"done","queue_duration_s":2.437898,"scheduling_latency_s":2.437931,"redis_calls":13,"redis_duration_s":0.001748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018987,"completed_at":"2026-07-28T08:17:11.500Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 271.018837] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eb97084755a8a1b676d977d","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eb97084755a8a1b676d977d: start","job_status":"start","queue_duration_s":2.458689,"scheduling_latency_s":2.458721}1300gitlab # [ 271.031725] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8eb97084755a8a1b676d977d","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8eb97084755a8a1b676d977d: done: 0.02016 sec","job_status":"done","queue_duration_s":2.458689,"scheduling_latency_s":2.458721,"redis_calls":13,"redis_duration_s":0.00209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00081,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02016,"completed_at":"2026-07-28T08:17:11.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 271.073462] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b0ff9310ff9d5e28fb9db9","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b0ff9310ff9d5e28fb9db9: start","job_status":"start","queue_duration_s":2.480713,"scheduling_latency_s":2.480745}1302gitlab # [ 271.086361] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01b0ff9310ff9d5e28fb9db9","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01b0ff9310ff9d5e28fb9db9: done: 0.020442 sec","job_status":"done","queue_duration_s":2.480713,"scheduling_latency_s":2.480745,"redis_calls":13,"redis_duration_s":0.002046,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020442,"completed_at":"2026-07-28T08:17:11.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 271.127088] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85362109246d6c9f9f4bbda4","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85362109246d6c9f9f4bbda4: start","job_status":"start","queue_duration_s":2.502986,"scheduling_latency_s":2.503016}1304gitlab # [ 271.140032] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85362109246d6c9f9f4bbda4","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85362109246d6c9f9f4bbda4: done: 0.019786 sec","job_status":"done","queue_duration_s":2.502986,"scheduling_latency_s":2.503016,"redis_calls":13,"redis_duration_s":0.002019,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019786,"completed_at":"2026-07-28T08:17:11.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 271.180318] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f82f72135ed9e8575e13a769","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f82f72135ed9e8575e13a769: start","job_status":"start","queue_duration_s":2.524423,"scheduling_latency_s":2.524453}1306gitlab # [ 271.193098] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f82f72135ed9e8575e13a769","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f82f72135ed9e8575e13a769: done: 0.021424 sec","job_status":"done","queue_duration_s":2.524423,"scheduling_latency_s":2.524453,"redis_calls":13,"redis_duration_s":0.002511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021424,"completed_at":"2026-07-28T08:17:11.589Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 271.233473] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c8e818d607686678db20d6b","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c8e818d607686678db20d6b: start","job_status":"start","queue_duration_s":2.547596,"scheduling_latency_s":2.547628}1308gitlab # [ 271.247568] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c8e818d607686678db20d6b","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c8e818d607686678db20d6b: done: 0.021014 sec","job_status":"done","queue_duration_s":2.547596,"scheduling_latency_s":2.547628,"redis_calls":13,"redis_duration_s":0.002419,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001598,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021014,"completed_at":"2026-07-28T08:17:11.611Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 271.288884] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48dd24c0e7cb917a2156a9bc","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48dd24c0e7cb917a2156a9bc: start","job_status":"start","queue_duration_s":2.570317,"scheduling_latency_s":2.570347}1310gitlab # [ 271.301752] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48dd24c0e7cb917a2156a9bc","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48dd24c0e7cb917a2156a9bc: done: 0.02082 sec","job_status":"done","queue_duration_s":2.570317,"scheduling_latency_s":2.570347,"redis_calls":13,"redis_duration_s":0.002441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00161,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02082,"completed_at":"2026-07-28T08:17:11.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 271.342406] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c94c3ef6672f25b64010f2b","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c94c3ef6672f25b64010f2b: start","job_status":"start","queue_duration_s":2.592766,"scheduling_latency_s":2.592799}1312gitlab # [ 271.355243] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c94c3ef6672f25b64010f2b","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c94c3ef6672f25b64010f2b: done: 0.02116 sec","job_status":"done","queue_duration_s":2.592766,"scheduling_latency_s":2.592799,"redis_calls":13,"redis_duration_s":0.002154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001367,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02116,"completed_at":"2026-07-28T08:17:11.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 271.395517] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bbb977c0e534232977c859e","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bbb977c0e534232977c859e: start","job_status":"start","queue_duration_s":2.615615,"scheduling_latency_s":2.615644}1314gitlab # [ 271.408466] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bbb977c0e534232977c859e","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bbb977c0e534232977c859e: done: 0.021242 sec","job_status":"done","queue_duration_s":2.615615,"scheduling_latency_s":2.615644,"redis_calls":13,"redis_duration_s":0.0025380000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001175,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021242,"completed_at":"2026-07-28T08:17:11.680Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 271.450401] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e367b0ac97a8527e3b7c38b5","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e367b0ac97a8527e3b7c38b5: start","job_status":"start","queue_duration_s":2.638713,"scheduling_latency_s":2.638745}1316gitlab # [ 271.463320] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e367b0ac97a8527e3b7c38b5","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e367b0ac97a8527e3b7c38b5: done: 0.020901 sec","job_status":"done","queue_duration_s":2.638713,"scheduling_latency_s":2.638745,"redis_calls":13,"redis_duration_s":0.002146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001315,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020901,"completed_at":"2026-07-28T08:17:11.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 271.504039] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"066c913ecbc05d0b31bfe6a7","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-066c913ecbc05d0b31bfe6a7: start","job_status":"start","queue_duration_s":2.661582,"scheduling_latency_s":2.661614}1318gitlab # [ 271.517012] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"066c913ecbc05d0b31bfe6a7","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-066c913ecbc05d0b31bfe6a7: done: 0.020846 sec","job_status":"done","queue_duration_s":2.661582,"scheduling_latency_s":2.661614,"redis_calls":13,"redis_duration_s":0.0022500000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020846,"completed_at":"2026-07-28T08:17:11.725Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 271.557410] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74d5321fe177d1c525ee68ac","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74d5321fe177d1c525ee68ac: start","job_status":"start","queue_duration_s":2.684426,"scheduling_latency_s":2.684457}1320gitlab # [ 271.570327] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74d5321fe177d1c525ee68ac","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74d5321fe177d1c525ee68ac: done: 0.021063 sec","job_status":"done","queue_duration_s":2.684426,"scheduling_latency_s":2.684457,"redis_calls":13,"redis_duration_s":0.002154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001348,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021063,"completed_at":"2026-07-28T08:17:11.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 271.611289] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92b479b654efed90c6406518","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92b479b654efed90c6406518: start","job_status":"start","queue_duration_s":2.707517,"scheduling_latency_s":2.707547}1322gitlab # [ 271.624509] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92b479b654efed90c6406518","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92b479b654efed90c6406518: done: 0.02083 sec","job_status":"done","queue_duration_s":2.707517,"scheduling_latency_s":2.707547,"redis_calls":13,"redis_duration_s":0.002166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001343,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02083,"completed_at":"2026-07-28T08:17:11.771Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 271.666625] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"628008e9bdf1c9116c9ca3a1","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-628008e9bdf1c9116c9ca3a1: start","job_status":"start","queue_duration_s":2.730502,"scheduling_latency_s":2.730534}1324gitlab # [ 271.679513] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"628008e9bdf1c9116c9ca3a1","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-628008e9bdf1c9116c9ca3a1: done: 0.021626 sec","job_status":"done","queue_duration_s":2.730502,"scheduling_latency_s":2.730534,"redis_calls":13,"redis_duration_s":0.002252,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001423,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021626,"completed_at":"2026-07-28T08:17:11.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 271.720125] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31025c9d24437b79c7e92a97","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31025c9d24437b79c7e92a97: start","job_status":"start","queue_duration_s":2.753802,"scheduling_latency_s":2.753832}1326gitlab # [ 271.734079] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31025c9d24437b79c7e92a97","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31025c9d24437b79c7e92a97: done: 0.02128 sec","job_status":"done","queue_duration_s":2.753802,"scheduling_latency_s":2.753832,"redis_calls":13,"redis_duration_s":0.002196,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000849,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001347,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02128,"completed_at":"2026-07-28T08:17:11.818Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 271.774718] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03fa849c66935f481c16531f","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03fa849c66935f481c16531f: start","job_status":"start","queue_duration_s":2.776771,"scheduling_latency_s":2.776803}1328gitlab # [ 271.787717] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03fa849c66935f481c16531f","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03fa849c66935f481c16531f: done: 0.020941 sec","job_status":"done","queue_duration_s":2.776771,"scheduling_latency_s":2.776803,"redis_calls":13,"redis_duration_s":0.002182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020941,"completed_at":"2026-07-28T08:17:11.840Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 271.828889] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"683455188b38f2277259ba80","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-683455188b38f2277259ba80: start","job_status":"start","queue_duration_s":2.799443,"scheduling_latency_s":2.799473}1330gitlab # [ 271.869467] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"683455188b38f2277259ba80","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-683455188b38f2277259ba80: done: 0.021344 sec","job_status":"done","queue_duration_s":2.799443,"scheduling_latency_s":2.799473,"redis_calls":13,"redis_duration_s":0.002306,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001363,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021344,"completed_at":"2026-07-28T08:17:11.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 271.946323] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"018198149907ac0b81e4f4c4","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-018198149907ac0b81e4f4c4: start","job_status":"start","queue_duration_s":2.822435,"scheduling_latency_s":2.822468}1332gitlab # [ 271.961255] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"018198149907ac0b81e4f4c4","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-018198149907ac0b81e4f4c4: done: 0.022571 sec","job_status":"done","queue_duration_s":2.822435,"scheduling_latency_s":2.822468,"redis_calls":13,"redis_duration_s":0.002274,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001488,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022571,"completed_at":"2026-07-28T08:17:11.888Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 272.002309] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3593984a717a4701408d24a","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3593984a717a4701408d24a: start","job_status":"start","queue_duration_s":2.846709,"scheduling_latency_s":2.846742}1334gitlab # [ 272.015353] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3593984a717a4701408d24a","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3593984a717a4701408d24a: done: 0.020965 sec","job_status":"done","queue_duration_s":2.846709,"scheduling_latency_s":2.846742,"redis_calls":13,"redis_duration_s":0.002216,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020965,"completed_at":"2026-07-28T08:17:11.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 272.055951] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"222e1fc19ecd38327c02f331","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-222e1fc19ecd38327c02f331: start","job_status":"start","queue_duration_s":2.869555,"scheduling_latency_s":2.869589}1336gitlab # [ 272.070515] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"222e1fc19ecd38327c02f331","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-222e1fc19ecd38327c02f331: done: 0.021095 sec","job_status":"done","queue_duration_s":2.869555,"scheduling_latency_s":2.869589,"redis_calls":13,"redis_duration_s":0.002319,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021095,"completed_at":"2026-07-28T08:17:11.933Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 272.111196] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f20fd69648d31dd4f570bd2e","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f20fd69648d31dd4f570bd2e: start","job_status":"start","queue_duration_s":2.892701,"scheduling_latency_s":2.892733}1338gitlab # [ 272.124238] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f20fd69648d31dd4f570bd2e","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f20fd69648d31dd4f570bd2e: done: 0.021749 sec","job_status":"done","queue_duration_s":2.892701,"scheduling_latency_s":2.892733,"redis_calls":13,"redis_duration_s":0.002295,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001364,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021749,"completed_at":"2026-07-28T08:17:11.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 272.164777] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efaee2c9246920b71494b45c","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efaee2c9246920b71494b45c: start","job_status":"start","queue_duration_s":2.916407,"scheduling_latency_s":2.916442}1340gitlab # [ 272.177571] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efaee2c9246920b71494b45c","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efaee2c9246920b71494b45c: done: 0.021247 sec","job_status":"done","queue_duration_s":2.916407,"scheduling_latency_s":2.916442,"redis_calls":13,"redis_duration_s":0.002663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001382,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021247,"completed_at":"2026-07-28T08:17:11.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 272.218080] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:11.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e604a995ffe1a31a9907c5","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e604a995ffe1a31a9907c5: start","job_status":"start","queue_duration_s":2.939435,"scheduling_latency_s":2.939466}1342gitlab # [ 272.230991] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e604a995ffe1a31a9907c5","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e604a995ffe1a31a9907c5: done: 0.041691 sec","job_status":"done","queue_duration_s":2.939435,"scheduling_latency_s":2.939466,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001554,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041691,"completed_at":"2026-07-28T08:17:12.024Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 272.272770] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc1fa296ff066bd881902c85","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc1fa296ff066bd881902c85: start","job_status":"start","queue_duration_s":2.984617,"scheduling_latency_s":2.984655}1344gitlab # [ 272.285481] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc1fa296ff066bd881902c85","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc1fa296ff066bd881902c85: done: 0.02465 sec","job_status":"done","queue_duration_s":2.984617,"scheduling_latency_s":2.984655,"redis_calls":13,"redis_duration_s":0.0039900000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002559,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02465,"completed_at":"2026-07-28T08:17:12.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 272.326601] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cedc8e91a847d6cb9588c9f5","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cedc8e91a847d6cb9588c9f5: start","job_status":"start","queue_duration_s":3.011563,"scheduling_latency_s":3.011598}1346gitlab # [ 272.339593] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cedc8e91a847d6cb9588c9f5","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cedc8e91a847d6cb9588c9f5: done: 0.025324 sec","job_status":"done","queue_duration_s":3.011563,"scheduling_latency_s":3.011598,"redis_calls":13,"redis_duration_s":0.003839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00146,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002379,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025324,"completed_at":"2026-07-28T08:17:12.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 272.380731] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7c82beaec11397ab26209fc","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7c82beaec11397ab26209fc: start","job_status":"start","queue_duration_s":3.039495,"scheduling_latency_s":3.039532}1348gitlab # [ 272.393548] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7c82beaec11397ab26209fc","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7c82beaec11397ab26209fc: done: 0.026032 sec","job_status":"done","queue_duration_s":3.039495,"scheduling_latency_s":3.039532,"redis_calls":13,"redis_duration_s":0.0047409999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026032,"completed_at":"2026-07-28T08:17:12.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 272.434493] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb4e4ada35c93a896ee07f6f","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb4e4ada35c93a896ee07f6f: start","job_status":"start","queue_duration_s":3.067756,"scheduling_latency_s":3.067788}1350gitlab # [ 272.447444] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb4e4ada35c93a896ee07f6f","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb4e4ada35c93a896ee07f6f: done: 0.025974 sec","job_status":"done","queue_duration_s":3.067756,"scheduling_latency_s":3.067788,"redis_calls":13,"redis_duration_s":0.004275,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00281,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025974,"completed_at":"2026-07-28T08:17:12.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 272.489831] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2607d1c5dbb3dd83ad65a409","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2607d1c5dbb3dd83ad65a409: start","job_status":"start","queue_duration_s":3.096138,"scheduling_latency_s":3.096173}1352gitlab # [ 272.502474] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2607d1c5dbb3dd83ad65a409","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2607d1c5dbb3dd83ad65a409: done: 0.025269 sec","job_status":"done","queue_duration_s":3.096138,"scheduling_latency_s":3.096173,"redis_calls":13,"redis_duration_s":0.0038050000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002517,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025269,"completed_at":"2026-07-28T08:17:12.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 272.543355] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad813064861d848445b05d01","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad813064861d848445b05d01: start","job_status":"start","queue_duration_s":3.123565,"scheduling_latency_s":3.123598}1354gitlab # [ 272.556364] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad813064861d848445b05d01","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad813064861d848445b05d01: done: 0.025086 sec","job_status":"done","queue_duration_s":3.123565,"scheduling_latency_s":3.123598,"redis_calls":13,"redis_duration_s":0.003708,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001277,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002431,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025086,"completed_at":"2026-07-28T08:17:12.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 272.596803] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc4b4a7bad8ee47548fc19a7","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc4b4a7bad8ee47548fc19a7: start","job_status":"start","queue_duration_s":3.151311,"scheduling_latency_s":3.151349}1356gitlab # [ 272.609781] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc4b4a7bad8ee47548fc19a7","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc4b4a7bad8ee47548fc19a7: done: 0.024508 sec","job_status":"done","queue_duration_s":3.151311,"scheduling_latency_s":3.151349,"redis_calls":13,"redis_duration_s":0.003303,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001251,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024508,"completed_at":"2026-07-28T08:17:12.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 272.650529] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fc5f3da667b5edfbe446c32","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fc5f3da667b5edfbe446c32: start","job_status":"start","queue_duration_s":3.178043,"scheduling_latency_s":3.17808}1358gitlab # [ 272.663526] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fc5f3da667b5edfbe446c32","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fc5f3da667b5edfbe446c32: done: 0.024244 sec","job_status":"done","queue_duration_s":3.178043,"scheduling_latency_s":3.17808,"redis_calls":13,"redis_duration_s":0.003124,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024244,"completed_at":"2026-07-28T08:17:12.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 272.705597] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9949817d4604e3f49a52910","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9949817d4604e3f49a52910: start","job_status":"start","queue_duration_s":3.204792,"scheduling_latency_s":3.204827}1360gitlab # [ 272.718536] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9949817d4604e3f49a52910","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9949817d4604e3f49a52910: done: 0.024844 sec","job_status":"done","queue_duration_s":3.204792,"scheduling_latency_s":3.204827,"redis_calls":13,"redis_duration_s":0.003737,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002391,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024844,"completed_at":"2026-07-28T08:17:12.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 272.758896] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7359300551bbbeedef1a7591","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7359300551bbbeedef1a7591: start","job_status":"start","queue_duration_s":3.232134,"scheduling_latency_s":3.232169}1362gitlab # [ 272.771963] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7359300551bbbeedef1a7591","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7359300551bbbeedef1a7591: done: 0.024541 sec","job_status":"done","queue_duration_s":3.232134,"scheduling_latency_s":3.232169,"redis_calls":13,"redis_duration_s":0.004052999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002557,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024541,"completed_at":"2026-07-28T08:17:12.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 272.813334] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1223b83dad691815fbde575","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1223b83dad691815fbde575: start","job_status":"start","queue_duration_s":3.259209,"scheduling_latency_s":3.259246}1364gitlab # [ 272.826312] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1223b83dad691815fbde575","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1223b83dad691815fbde575: done: 0.025216 sec","job_status":"done","queue_duration_s":3.259209,"scheduling_latency_s":3.259246,"redis_calls":13,"redis_duration_s":0.00411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002532,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025216,"completed_at":"2026-07-28T08:17:12.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 272.867197] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39ebe96c984bc8cfc36fd856","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39ebe96c984bc8cfc36fd856: start","job_status":"start","queue_duration_s":3.287028,"scheduling_latency_s":3.287064}1366gitlab # [ 272.881618] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39ebe96c984bc8cfc36fd856","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39ebe96c984bc8cfc36fd856: done: 0.024568 sec","job_status":"done","queue_duration_s":3.287028,"scheduling_latency_s":3.287064,"redis_calls":13,"redis_duration_s":0.003909,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024568,"completed_at":"2026-07-28T08:17:12.354Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 272.922132] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f73b92995545a4b8d213a337","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f73b92995545a4b8d213a337: start","job_status":"start","queue_duration_s":3.313597,"scheduling_latency_s":3.313632}1368gitlab # [ 272.935208] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f73b92995545a4b8d213a337","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f73b92995545a4b8d213a337: done: 0.024074 sec","job_status":"done","queue_duration_s":3.313597,"scheduling_latency_s":3.313632,"redis_calls":13,"redis_duration_s":0.00408,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001299,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002781,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024074,"completed_at":"2026-07-28T08:17:12.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 272.975901] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baa2dcca38ee331a000c8eac","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baa2dcca38ee331a000c8eac: start","job_status":"start","queue_duration_s":3.340015,"scheduling_latency_s":3.340046}1370gitlab # [ 272.988976] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baa2dcca38ee331a000c8eac","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baa2dcca38ee331a000c8eac: done: 0.023917 sec","job_status":"done","queue_duration_s":3.340015,"scheduling_latency_s":3.340046,"redis_calls":13,"redis_duration_s":0.0038120000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002586,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023917,"completed_at":"2026-07-28T08:17:12.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 273.029498] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3158f493bac2ed090d0b616b","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3158f493bac2ed090d0b616b: start","job_status":"start","queue_duration_s":3.366013,"scheduling_latency_s":3.366046}1372gitlab # [ 273.042453] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3158f493bac2ed090d0b616b","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3158f493bac2ed090d0b616b: done: 0.023321 sec","job_status":"done","queue_duration_s":3.366013,"scheduling_latency_s":3.366046,"redis_calls":13,"redis_duration_s":0.0030499999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023321,"completed_at":"2026-07-28T08:17:12.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 273.084724] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b80e675a183cf55056b27a6","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b80e675a183cf55056b27a6: start","job_status":"start","queue_duration_s":3.391537,"scheduling_latency_s":3.391568}1374gitlab # [ 273.097526] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b80e675a183cf55056b27a6","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b80e675a183cf55056b27a6: done: 0.020322 sec","job_status":"done","queue_duration_s":3.391537,"scheduling_latency_s":3.391568,"redis_calls":13,"redis_duration_s":0.0030289999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020322,"completed_at":"2026-07-28T08:17:12.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 273.138308] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e43067de935bff6cf244019","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e43067de935bff6cf244019: start","job_status":"start","queue_duration_s":3.413681,"scheduling_latency_s":3.41371}1376gitlab # [ 273.151197] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e43067de935bff6cf244019","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e43067de935bff6cf244019: done: 0.020064 sec","job_status":"done","queue_duration_s":3.413681,"scheduling_latency_s":3.41371,"redis_calls":13,"redis_duration_s":0.003005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001177,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020064,"completed_at":"2026-07-28T08:17:12.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 273.192102] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15d3383e7b46ca8a71271f40","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15d3383e7b46ca8a71271f40: start","job_status":"start","queue_duration_s":3.435554,"scheduling_latency_s":3.435583}1378gitlab # [ 273.204657] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15d3383e7b46ca8a71271f40","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15d3383e7b46ca8a71271f40: done: 0.032911 sec","job_status":"done","queue_duration_s":3.435554,"scheduling_latency_s":3.435583,"redis_calls":13,"redis_duration_s":0.011865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005758,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032911,"completed_at":"2026-07-28T08:17:12.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 273.245019] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9eb88fe116b9fbf67e8e2619","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9eb88fe116b9fbf67e8e2619: start","job_status":"start","queue_duration_s":3.470508,"scheduling_latency_s":3.470537}1380gitlab # [ 273.257857] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:17:12.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9eb88fe116b9fbf67e8e2619","created_at":"2026-07-28T08:17:08.419Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-f4a2d72dfc834a1f","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ff650b766abdc287b3b0a97dcc091c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:17:09.043Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9eb88fe116b9fbf67e8e2619: done: 0.021456 sec","job_status":"done","queue_duration_s":3.470508,"scheduling_latency_s":3.470537,"redis_calls":13,"redis_duration_s":0.003013,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021456,"completed_at":"2026-07-28T08:17:12.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 311.209576] redis[1265]: 10 changes in 300 seconds. Saving...1382gitlab # [ 311.217625] redis[1265]: Background saving started by pid 38611383gitlab # [ 311.222138] redis[3861]: BGSAVE done, 423 keys saved, 0 keys skipped, 112012 bytes written.1384gitlab # [ 311.226564] redis[3861]: DB saved on disk1385gitlab # [ 311.228889] redis[3861]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1386gitlab # [ 311.310749] redis[1265]: Background saving terminated with success1387gitlab # [ 312.298876] postgres[1336]: [1336] LOG: checkpoint starting: time1388gitlab # [ 314.148659] gitaly[1368]: time="2026-07-28T08:17:55.024Z" level=info msg="burden monitor stats" pid=1368 top_10_by_cpu="[]" top_10_by_memory="[]"1389gitlab # [ 320.294854] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:01.170Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"24ab4442616b7dc1b35bd736","created_at":"2026-07-28T08:18:01.143Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.166Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-24ab4442616b7dc1b35bd736: start","job_status":"start","queue_duration_s":0.004048,"scheduling_latency_s":0.00412}1390gitlab # [ 320.558152] setup-gitlab-start[3658]: W, [2026-07-28T08:18:01.434328 #3658] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1391gitlab # [ 320.580267] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:01.456Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"24ab4442616b7dc1b35bd736","created_at":"2026-07-28T08:18:01.143Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.166Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-24ab4442616b7dc1b35bd736: done: 0.286014 sec","job_status":"done","queue_duration_s":0.004048,"scheduling_latency_s":0.00412,"redis_calls":20,"redis_duration_s":0.057633000000000004,"redis_read_bytes":783,"redis_write_bytes":4430,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.023956,"redis_feature_flag_read_bytes":768,"redis_feature_flag_write_bytes":400,"redis_queues_calls":2,"redis_queues_duration_s":0.002077,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.02245,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00915,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.286014,"completed_at":"2026-07-28T08:18:01.456Z","load_balancing_strategy":"primary","db_duration_s":0.013348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 320.677946] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:01.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6ba13cc30a044e65c2cf69ec","created_at":"2026-07-28T08:18:01.191Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"403425206b7930ce30536a6f8fbf713f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.198Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6ba13cc30a044e65c2cf69ec: start","job_status":"start","queue_duration_s":0.323662,"scheduling_latency_s":0.323739}1393gitlab # [ 320.701137] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:01.578Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1394gitlab # [ 320.742244] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:01.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6ba13cc30a044e65c2cf69ec","created_at":"2026-07-28T08:18:01.191Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"403425206b7930ce30536a6f8fbf713f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.198Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6ba13cc30a044e65c2cf69ec: done: 0.096108 sec","job_status":"done","queue_duration_s":0.323662,"scheduling_latency_s":0.323739,"redis_calls":7,"redis_duration_s":0.021152999999999998,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016381,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004772,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.096108,"completed_at":"2026-07-28T08:18:01.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 320.829651] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:01.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ac3a1b9841136af2c430ba29","created_at":"2026-07-28T08:18:01.230Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b37590480722adb3071f0fe9ef096f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.244Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ac3a1b9841136af2c430ba29: start","job_status":"start","queue_duration_s":0.382656,"scheduling_latency_s":0.382723}1396gitlab # [ 320.850134] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:01.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ac3a1b9841136af2c430ba29","created_at":"2026-07-28T08:18:01.230Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b37590480722adb3071f0fe9ef096f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.244Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ac3a1b9841136af2c430ba29: done: 0.071133 sec","job_status":"done","queue_duration_s":0.382656,"scheduling_latency_s":0.382723,"redis_calls":7,"redis_duration_s":0.007636,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006261,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001375,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071133,"completed_at":"2026-07-28T08:18:01.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 320.904648] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:01.726Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"418c0a74747f765a0ebdacd3","created_at":"2026-07-28T08:18:01.276Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.286Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-418c0a74747f765a0ebdacd3: start","job_status":"start","queue_duration_s":0.439401,"scheduling_latency_s":0.43947}1398gitlab # [ 321.698281] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"418c0a74747f765a0ebdacd3","created_at":"2026-07-28T08:18:01.276Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.286Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-418c0a74747f765a0ebdacd3: done: 0.848262 sec","job_status":"done","queue_duration_s":0.439401,"scheduling_latency_s":0.43947,"redis_calls":60,"redis_duration_s":0.364664,"redis_read_bytes":108,"redis_write_bytes":41009,"redis_queues_calls":2,"redis_queues_duration_s":0.001896,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.353889,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.008879,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.325835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.848262,"completed_at":"2026-07-28T08:18:02.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 321.756989] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"881b13130770cb988bcfa5e1","created_at":"2026-07-28T08:18:01.357Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41beb2d6694250fb84eb4e5cda5e8fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.372Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-881b13130770cb988bcfa5e1: start","job_status":"start","queue_duration_s":1.2093,"scheduling_latency_s":1.209357}1400gitlab # [ 321.775620] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"881b13130770cb988bcfa5e1","created_at":"2026-07-28T08:18:01.357Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41beb2d6694250fb84eb4e5cda5e8fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.372Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-881b13130770cb988bcfa5e1: done: 0.071422 sec","job_status":"done","queue_duration_s":1.2093,"scheduling_latency_s":1.209357,"redis_calls":7,"redis_duration_s":0.015219,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01254,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002679,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.071422,"completed_at":"2026-07-28T08:18:02.652Z","load_balancing_strategy":"primary","db_duration_s":0.017367,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 321.835752] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.655Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bbff24f9708651e199acb734","created_at":"2026-07-28T08:18:01.288Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-cfedaea65cac4df9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.374Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bbff24f9708651e199acb734: start","job_status":"start","queue_duration_s":1.280775,"scheduling_latency_s":1.280811}1402gitlab # [ 321.867933] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.679Z","message":"No existing merge request to be cleaned up."}1403gitlab # [ 321.872632] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.696Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bbff24f9708651e199acb734","created_at":"2026-07-28T08:18:01.288Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-cfedaea65cac4df9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.374Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bbff24f9708651e199acb734: done: 0.041444 sec","job_status":"done","queue_duration_s":1.280775,"scheduling_latency_s":1.280811,"redis_calls":10,"redis_duration_s":0.003191,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001803,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041444,"completed_at":"2026-07-28T08:18:02.696Z","load_balancing_strategy":"primary","db_duration_s":0.00746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 321.939562] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.698Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c15831c052a63f73ac0308d2","created_at":"2026-07-28T08:18:01.288Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-cfedaea65cac4df9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.374Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c15831c052a63f73ac0308d2: start","job_status":"start","queue_duration_s":1.324538,"scheduling_latency_s":1.324578}1405gitlab # [ 321.954345] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.720Z","message":"No existing merge request to be cleaned up."}1406gitlab # [ 321.956186] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.736Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c15831c052a63f73ac0308d2","created_at":"2026-07-28T08:18:01.288Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-cfedaea65cac4df9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.374Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c15831c052a63f73ac0308d2: done: 0.037825 sec","job_status":"done","queue_duration_s":1.324538,"scheduling_latency_s":1.324578,"redis_calls":10,"redis_duration_s":0.002824,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001634,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037825,"completed_at":"2026-07-28T08:18:02.736Z","load_balancing_strategy":"primary","db_duration_s":0.004237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 321.996043] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.738Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a7d5c9ceb9bc9eac6c1599be","created_at":"2026-07-28T08:18:01.288Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-cfedaea65cac4df9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.374Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a7d5c9ceb9bc9eac6c1599be: start","job_status":"start","queue_duration_s":1.364577,"scheduling_latency_s":1.364616}1408gitlab # [ 322.008678] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.757Z","message":"No existing merge request to be cleaned up."}1409gitlab # [ 322.010456] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.771Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a7d5c9ceb9bc9eac6c1599be","created_at":"2026-07-28T08:18:01.288Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-cfedaea65cac4df9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.374Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a7d5c9ceb9bc9eac6c1599be: done: 0.032636 sec","job_status":"done","queue_duration_s":1.364577,"scheduling_latency_s":1.364616,"redis_calls":10,"redis_duration_s":0.002717,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001571,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032636,"completed_at":"2026-07-28T08:18:02.771Z","load_balancing_strategy":"primary","db_duration_s":0.003319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 322.050709] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.773Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efefdb606f53d4cac85cfcbe","created_at":"2026-07-28T08:18:01.288Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-cfedaea65cac4df9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.374Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efefdb606f53d4cac85cfcbe: start","job_status":"start","queue_duration_s":1.399169,"scheduling_latency_s":1.399205}1411gitlab # [ 322.063566] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.793Z","message":"No existing merge request to be cleaned up."}1412gitlab # [ 322.065399] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.807Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efefdb606f53d4cac85cfcbe","created_at":"2026-07-28T08:18:01.288Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-cfedaea65cac4df9","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a9e9b684fdf032472897a4eb6782cf41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.374Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efefdb606f53d4cac85cfcbe: done: 0.03357 sec","job_status":"done","queue_duration_s":1.399169,"scheduling_latency_s":1.399205,"redis_calls":10,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001545,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03357,"completed_at":"2026-07-28T08:18:02.806Z","load_balancing_strategy":"primary","db_duration_s":0.004036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 322.106728] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a67cdbf29e79518f0473f809","created_at":"2026-07-28T08:18:01.402Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"907ff06408ec4d7469f1300086d11e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.416Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a67cdbf29e79518f0473f809: start","job_status":"start","queue_duration_s":1.392311,"scheduling_latency_s":1.392346}1414gitlab # [ 322.121973] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.822Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1415gitlab # [ 322.125776] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.830Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"a67cdbf29e79518f0473f809","created_at":"2026-07-28T08:18:01.402Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"907ff06408ec4d7469f1300086d11e4c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.416Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-a67cdbf29e79518f0473f809: done: 0.021644 sec","job_status":"done","queue_duration_s":1.392311,"scheduling_latency_s":1.392346,"redis_calls":7,"redis_duration_s":0.0017039999999999998,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021644,"completed_at":"2026-07-28T08:18:02.830Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 322.168057] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e34843d36fa38bebbee7e080","created_at":"2026-07-28T08:18:01.439Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a4aaaf0fa4bee2f4ff0c3230d048f47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.449Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e34843d36fa38bebbee7e080: start","job_status":"start","queue_duration_s":1.384356,"scheduling_latency_s":1.384393}1417gitlab # [ 322.183196] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e34843d36fa38bebbee7e080","created_at":"2026-07-28T08:18:01.439Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a4aaaf0fa4bee2f4ff0c3230d048f47","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.449Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e34843d36fa38bebbee7e080: done: 0.082694 sec","job_status":"done","queue_duration_s":1.384356,"scheduling_latency_s":1.384393,"redis_calls":9,"redis_duration_s":0.002815,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00137,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001445,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00113336,"exclusive_lock_hold_duration_s":0.03640856,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.082694,"completed_at":"2026-07-28T08:18:02.916Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041843,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 322.228206] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.918Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"75d2130aec7707177b716347","created_at":"2026-07-28T08:18:01.524Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af954a46bfe8a1f5a9fc7927fd6781ec","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.537Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-75d2130aec7707177b716347: start","job_status":"start","queue_duration_s":1.38142,"scheduling_latency_s":1.38146}1419gitlab # [ 322.243238] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"75d2130aec7707177b716347","created_at":"2026-07-28T08:18:01.524Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af954a46bfe8a1f5a9fc7927fd6781ec","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.537Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-75d2130aec7707177b716347: done: 0.036477 sec","job_status":"done","queue_duration_s":1.38142,"scheduling_latency_s":1.38146,"redis_calls":10,"redis_duration_s":0.002865,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00849706,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.036477,"completed_at":"2026-07-28T08:18:02.954Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004561,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1420gitlab # [ 322.287536] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.957Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c389d06f11b609d2222dab22","created_at":"2026-07-28T08:18:01.580Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adb4db2af0d8caf0413c8bbeeb197c4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-28T08:18:01.593Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c389d06f11b609d2222dab22: start","job_status":"start","queue_duration_s":1.363619,"scheduling_latency_s":1.363656}1421gitlab # [ 322.302768] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.970Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1422gitlab # [ 322.306783] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c389d06f11b609d2222dab22","created_at":"2026-07-28T08:18:01.580Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adb4db2af0d8caf0413c8bbeeb197c4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-28T08:18:01.593Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c389d06f11b609d2222dab22: done: 0.023061 sec","job_status":"done","queue_duration_s":1.363619,"scheduling_latency_s":1.363656,"redis_calls":7,"redis_duration_s":0.0017720000000000001,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001265,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000507,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023061,"completed_at":"2026-07-28T08:18:02.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 322.347846] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:02.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ab84995826b8f2eaa7da2677","created_at":"2026-07-28T08:18:01.612Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abbb9801a3e1a5189851d9dbce24252b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.623Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ab84995826b8f2eaa7da2677: start","job_status":"start","queue_duration_s":1.36005,"scheduling_latency_s":1.360086}1424gitlab # [ 322.363617] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ab84995826b8f2eaa7da2677","created_at":"2026-07-28T08:18:01.612Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abbb9801a3e1a5189851d9dbce24252b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.623Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ab84995826b8f2eaa7da2677: done: 0.028814 sec","job_status":"done","queue_duration_s":1.36005,"scheduling_latency_s":1.360086,"redis_calls":9,"redis_duration_s":0.0025849999999999996,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001264,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00087262,"exclusive_lock_hold_duration_s":0.00471034,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.028814,"completed_at":"2026-07-28T08:18:03.011Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 322.407586] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ecf2d266139a6e005ced4183","created_at":"2026-07-28T08:18:01.675Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d27dc6da99805bb919a95dd306874569","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.691Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ecf2d266139a6e005ced4183: start","job_status":"start","queue_duration_s":1.322354,"scheduling_latency_s":1.322388}1426gitlab # [ 322.423017] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ecf2d266139a6e005ced4183","created_at":"2026-07-28T08:18:01.675Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d27dc6da99805bb919a95dd306874569","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.691Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ecf2d266139a6e005ced4183: done: 0.023416 sec","job_status":"done","queue_duration_s":1.322354,"scheduling_latency_s":1.322388,"redis_calls":7,"redis_duration_s":0.001823,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023416,"completed_at":"2026-07-28T08:18:03.037Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 322.464859] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4386db128f652d015f3186e3","created_at":"2026-07-28T08:18:01.728Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0968e6f0dc61fffbcf44796026a47200","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.737Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4386db128f652d015f3186e3: start","job_status":"start","queue_duration_s":1.302538,"scheduling_latency_s":1.302574}1428gitlab # [ 322.507086] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4386db128f652d015f3186e3","created_at":"2026-07-28T08:18:01.728Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0968e6f0dc61fffbcf44796026a47200","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.737Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4386db128f652d015f3186e3: done: 0.344562 sec","job_status":"done","queue_duration_s":1.302538,"scheduling_latency_s":1.302574,"redis_calls":11,"redis_duration_s":0.003091,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001265,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":124,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":124,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":124,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.265963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00095466,"exclusive_lock_hold_duration_s":0.31102642,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.344562,"completed_at":"2026-07-28T08:18:03.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.093328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 322.554603] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"be4bd320df28aedef892ac19","created_at":"2026-07-28T08:18:01.775Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"152751ec1744ee8efb33b302b399dd6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-28T08:18:01.794Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-be4bd320df28aedef892ac19: start","job_status":"start","queue_duration_s":1.59195,"scheduling_latency_s":1.591981}1430gitlab # [ 322.568532] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.399Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1431gitlab # [ 322.571880] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"be4bd320df28aedef892ac19","created_at":"2026-07-28T08:18:01.775Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"152751ec1744ee8efb33b302b399dd6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-28T08:18:01.794Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-be4bd320df28aedef892ac19: done: 0.023706 sec","job_status":"done","queue_duration_s":1.59195,"scheduling_latency_s":1.591981,"redis_calls":7,"redis_duration_s":0.001611,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023706,"completed_at":"2026-07-28T08:18:03.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 322.612799] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.413Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5f211e2f151d9e8f74d797b5","created_at":"2026-07-28T08:18:01.835Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e7e59cb6c452f7aae9997688b4cccd9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.850Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5f211e2f151d9e8f74d797b5: start","job_status":"start","queue_duration_s":1.563433,"scheduling_latency_s":1.563466}1433gitlab # [ 322.627372] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.442Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5f211e2f151d9e8f74d797b5","created_at":"2026-07-28T08:18:01.835Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e7e59cb6c452f7aae9997688b4cccd9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.850Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5f211e2f151d9e8f74d797b5: done: 0.029114 sec","job_status":"done","queue_duration_s":1.563433,"scheduling_latency_s":1.563466,"redis_calls":7,"redis_duration_s":0.001739,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001253,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029114,"completed_at":"2026-07-28T08:18:03.442Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 322.669733] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"515fd5d3fe505b5f986647c1","created_at":"2026-07-28T08:18:01.878Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a3b766669bd15397dba4c2b19bd294c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.892Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-515fd5d3fe505b5f986647c1: start","job_status":"start","queue_duration_s":1.55211,"scheduling_latency_s":1.552144}1435gitlab # [ 322.683815] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.478Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"515fd5d3fe505b5f986647c1","created_at":"2026-07-28T08:18:01.878Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a3b766669bd15397dba4c2b19bd294c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:01.892Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-515fd5d3fe505b5f986647c1: done: 0.033567 sec","job_status":"done","queue_duration_s":1.55211,"scheduling_latency_s":1.552144,"redis_calls":9,"redis_duration_s":0.0025729999999999998,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001401,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00086566,"exclusive_lock_hold_duration_s":0.00683964,"duration_s":0.033567,"completed_at":"2026-07-28T08:18:03.478Z","load_balancing_strategy":"primary","db_duration_s":0.002194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 322.726914] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.480Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6345580f8b65f47ebb959874","created_at":"2026-07-28T08:18:01.919Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d30c2c77f9e84b75ecec3909e905976b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-28T08:18:01.933Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6345580f8b65f47ebb959874: start","job_status":"start","queue_duration_s":1.547367,"scheduling_latency_s":1.547403}1437gitlab # [ 322.740648] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6345580f8b65f47ebb959874","created_at":"2026-07-28T08:18:01.919Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d30c2c77f9e84b75ecec3909e905976b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-28T08:18:01.933Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6345580f8b65f47ebb959874: done: 0.035424 sec","job_status":"done","queue_duration_s":1.547367,"scheduling_latency_s":1.547403,"redis_calls":7,"redis_duration_s":0.002128,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001585,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035424,"completed_at":"2026-07-28T08:18:03.515Z","load_balancing_strategy":"primary","db_duration_s":0.00347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 322.781541] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.519Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"d68ab6e9e7ef5877f11f9679","created_at":"2026-07-28T08:18:01.972Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f6eb26ea94ae75a5f34757522ec01d7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.014Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-d68ab6e9e7ef5877f11f9679: start","job_status":"start","queue_duration_s":1.505338,"scheduling_latency_s":1.505373}1439gitlab # [ 322.796579] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"d68ab6e9e7ef5877f11f9679","created_at":"2026-07-28T08:18:01.972Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f6eb26ea94ae75a5f34757522ec01d7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.014Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-d68ab6e9e7ef5877f11f9679: done: 0.041273 sec","job_status":"done","queue_duration_s":1.505338,"scheduling_latency_s":1.505373,"redis_calls":12,"redis_duration_s":0.002623,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006554,"exclusive_lock_hold_duration_s":0.01026258,"duration_s":0.041273,"completed_at":"2026-07-28T08:18:03.560Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 322.840741] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.562Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e3f98099b7de2886c0567b6d","created_at":"2026-07-28T08:18:02.043Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2cffa75eb4c1a8ec61df98d14434743","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.054Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e3f98099b7de2886c0567b6d: start","job_status":"start","queue_duration_s":1.50811,"scheduling_latency_s":1.508139}1441gitlab # [ 322.855210] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.596Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e3f98099b7de2886c0567b6d","created_at":"2026-07-28T08:18:02.043Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2cffa75eb4c1a8ec61df98d14434743","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.054Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e3f98099b7de2886c0567b6d: done: 0.03411 sec","job_status":"done","queue_duration_s":1.50811,"scheduling_latency_s":1.508139,"redis_calls":7,"redis_duration_s":0.001567,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03411,"completed_at":"2026-07-28T08:18:03.596Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 322.896793] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2445750973f018ee796222f8","created_at":"2026-07-28T08:18:02.084Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90bf8833e6c58e67debe1049f52d9e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.097Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2445750973f018ee796222f8: start","job_status":"start","queue_duration_s":1.501351,"scheduling_latency_s":1.501384}1443gitlab # [ 323.082482] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2445750973f018ee796222f8","created_at":"2026-07-28T08:18:02.084Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90bf8833e6c58e67debe1049f52d9e6e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.097Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2445750973f018ee796222f8: done: 0.361111 sec","job_status":"done","queue_duration_s":1.501351,"scheduling_latency_s":1.501384,"redis_calls":571,"redis_duration_s":0.07251099999999999,"redis_read_bytes":569,"redis_write_bytes":49487,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.07132,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.327031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.361111,"completed_at":"2026-07-28T08:18:03.959Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 323.143075] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.961Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d0c83a3778a212527ca1cd81","created_at":"2026-07-28T08:18:02.126Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48eec10e194a9b71dc3681a95cc6deac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.139Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d0c83a3778a212527ca1cd81: start","job_status":"start","queue_duration_s":1.821786,"scheduling_latency_s":1.821818}1445gitlab # [ 323.160160] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.971Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1446gitlab # [ 323.163602] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d0c83a3778a212527ca1cd81","created_at":"2026-07-28T08:18:02.126Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48eec10e194a9b71dc3681a95cc6deac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.139Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d0c83a3778a212527ca1cd81: done: 0.019408 sec","job_status":"done","queue_duration_s":1.821786,"scheduling_latency_s":1.821818,"redis_calls":7,"redis_duration_s":0.001669,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019408,"completed_at":"2026-07-28T08:18:03.980Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 323.206396] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:03.982Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"0dd88b292ad7cec1f3cfd2b0","created_at":"2026-07-28T08:18:02.179Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61c42cfe6f76decf1c417f92f56ea365","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.210Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-0dd88b292ad7cec1f3cfd2b0: start","job_status":"start","queue_duration_s":1.772337,"scheduling_latency_s":1.772367}1448gitlab # [ 323.223891] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.007Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"0dd88b292ad7cec1f3cfd2b0","created_at":"2026-07-28T08:18:02.179Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61c42cfe6f76decf1c417f92f56ea365","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.210Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-0dd88b292ad7cec1f3cfd2b0: done: 0.024851 sec","job_status":"done","queue_duration_s":1.772337,"scheduling_latency_s":1.772367,"redis_calls":12,"redis_duration_s":0.002051,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00052,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027782,"duration_s":0.024851,"completed_at":"2026-07-28T08:18:04.007Z","load_balancing_strategy":"primary","db_duration_s":0.00094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 323.268320] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2be680cfaed9f94ba0e6d591","created_at":"2026-07-28T08:18:02.237Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d60815f480f4f33cbeb77b460ba51833","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.251Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2be680cfaed9f94ba0e6d591: start","job_status":"start","queue_duration_s":1.75789,"scheduling_latency_s":1.757915}1450gitlab # [ 323.283071] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2be680cfaed9f94ba0e6d591","created_at":"2026-07-28T08:18:02.237Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d60815f480f4f33cbeb77b460ba51833","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.251Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2be680cfaed9f94ba0e6d591: done: 0.096803 sec","job_status":"done","queue_duration_s":1.75789,"scheduling_latency_s":1.757915,"redis_calls":9,"redis_duration_s":0.002222,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.035,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00070302,"exclusive_lock_hold_duration_s":0.07507018,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.096803,"completed_at":"2026-07-28T08:18:04.105Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.062968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 323.328903] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.107Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"881dd40b336dca205e88f228","created_at":"2026-07-28T08:18:02.284Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cfa02f00c5dfbb5c509e43a79195f4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.300Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-881dd40b336dca205e88f228: start","job_status":"start","queue_duration_s":1.807278,"scheduling_latency_s":1.807309}1452gitlab # [ 323.343943] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.117Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1453gitlab # [ 323.348053] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"881dd40b336dca205e88f228","created_at":"2026-07-28T08:18:02.284Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cfa02f00c5dfbb5c509e43a79195f4b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.300Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-881dd40b336dca205e88f228: done: 0.017933 sec","job_status":"done","queue_duration_s":1.807278,"scheduling_latency_s":1.807309,"redis_calls":7,"redis_duration_s":0.0013239999999999999,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017933,"completed_at":"2026-07-28T08:18:04.125Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 323.390727] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"81da06c4b5651115340a1862","created_at":"2026-07-28T08:18:02.493Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d4a4c43da29218972281eaec9a1bf2f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.525Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-81da06c4b5651115340a1862: start","job_status":"start","queue_duration_s":1.602077,"scheduling_latency_s":1.60211}1455gitlab # [ 323.407847] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"81da06c4b5651115340a1862","created_at":"2026-07-28T08:18:02.493Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d4a4c43da29218972281eaec9a1bf2f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.525Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-81da06c4b5651115340a1862: done: 0.031862 sec","job_status":"done","queue_duration_s":1.602077,"scheduling_latency_s":1.60211,"redis_calls":12,"redis_duration_s":0.002369,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000415,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030786,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.031862,"completed_at":"2026-07-28T08:18:04.159Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 323.456162] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83ae7d2f020c14a0c13c5e6f","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83ae7d2f020c14a0c13c5e6f: start","job_status":"start","queue_duration_s":1.618154,"scheduling_latency_s":1.618183}1457gitlab # [ 323.524610] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83ae7d2f020c14a0c13c5e6f","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83ae7d2f020c14a0c13c5e6f: done: 0.239758 sec","job_status":"done","queue_duration_s":1.618154,"scheduling_latency_s":1.618183,"redis_calls":13,"redis_duration_s":0.002552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001604,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.239758,"completed_at":"2026-07-28T08:18:04.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 323.626675] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fedb24896e8d35b023a01333","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fedb24896e8d35b023a01333: start","job_status":"start","queue_duration_s":1.960497,"scheduling_latency_s":1.960564}1459gitlab # [ 323.795584] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fedb24896e8d35b023a01333","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fedb24896e8d35b023a01333: done: 0.167508 sec","job_status":"done","queue_duration_s":1.960497,"scheduling_latency_s":1.960564,"redis_calls":13,"redis_duration_s":0.024336,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006431,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.167508,"completed_at":"2026-07-28T08:18:04.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 323.924162] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"988dfc5b3774c640e59c23c3","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-988dfc5b3774c640e59c23c3: start","job_status":"start","queue_duration_s":2.257977,"scheduling_latency_s":2.258041}1461gitlab # [ 324.098652] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:04.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"988dfc5b3774c640e59c23c3","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-988dfc5b3774c640e59c23c3: done: 0.174012 sec","job_status":"done","queue_duration_s":2.257977,"scheduling_latency_s":2.258041,"redis_calls":13,"redis_duration_s":0.019658000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008292,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011366,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.174012,"completed_at":"2026-07-28T08:18:04.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 324.264151] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d24261111182af5a5a3ecbe","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d24261111182af5a5a3ecbe: start","job_status":"start","queue_duration_s":2.595784,"scheduling_latency_s":2.595832}1463gitlab # [ 324.422974] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d24261111182af5a5a3ecbe","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d24261111182af5a5a3ecbe: done: 0.160423 sec","job_status":"done","queue_duration_s":2.595784,"scheduling_latency_s":2.595832,"redis_calls":13,"redis_duration_s":0.039274,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.014779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.024495,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.160423,"completed_at":"2026-07-28T08:18:05.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 324.500416] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d00728d6efc7dd7e30f5a1","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d00728d6efc7dd7e30f5a1: start","job_status":"start","queue_duration_s":2.764625,"scheduling_latency_s":2.764686}1465gitlab # [ 324.515224] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d00728d6efc7dd7e30f5a1","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d00728d6efc7dd7e30f5a1: done: 0.083522 sec","job_status":"done","queue_duration_s":2.764625,"scheduling_latency_s":2.764686,"redis_calls":13,"redis_duration_s":0.005703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002003,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.083522,"completed_at":"2026-07-28T08:18:05.391Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 324.559410] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec7aeaa5f079584f3457bec4","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec7aeaa5f079584f3457bec4: start","job_status":"start","queue_duration_s":2.856224,"scheduling_latency_s":2.856293}1467gitlab # [ 324.643028] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec7aeaa5f079584f3457bec4","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec7aeaa5f079584f3457bec4: done: 0.120296 sec","job_status":"done","queue_duration_s":2.856224,"scheduling_latency_s":2.856293,"redis_calls":13,"redis_duration_s":0.024289,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008184,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.016105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.120296,"completed_at":"2026-07-28T08:18:05.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 324.722396] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d8a7e413f81a35e30b9b449","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d8a7e413f81a35e30b9b449: start","job_status":"start","queue_duration_s":2.984053,"scheduling_latency_s":2.984113}1469gitlab # [ 324.737671] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d8a7e413f81a35e30b9b449","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d8a7e413f81a35e30b9b449: done: 0.079671 sec","job_status":"done","queue_duration_s":2.984053,"scheduling_latency_s":2.984113,"redis_calls":13,"redis_duration_s":0.008518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006639,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.079671,"completed_at":"2026-07-28T08:18:05.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 324.783890] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7caf7956b24a0199ade65117","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7caf7956b24a0199ade65117: start","job_status":"start","queue_duration_s":3.072332,"scheduling_latency_s":3.072396}1471gitlab # [ 324.839827] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7caf7956b24a0199ade65117","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7caf7956b24a0199ade65117: done: 0.100696 sec","job_status":"done","queue_duration_s":3.072332,"scheduling_latency_s":3.072396,"redis_calls":13,"redis_duration_s":0.008334000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003306,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.100696,"completed_at":"2026-07-28T08:18:05.715Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 324.896752] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40ce2956e2dff37d44fb362a","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40ce2956e2dff37d44fb362a: start","job_status":"start","queue_duration_s":3.187215,"scheduling_latency_s":3.187283}1473gitlab # [ 324.998032] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40ce2956e2dff37d44fb362a","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40ce2956e2dff37d44fb362a: done: 0.142532 sec","job_status":"done","queue_duration_s":3.187215,"scheduling_latency_s":3.187283,"redis_calls":13,"redis_duration_s":0.032345,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.023366,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.142532,"completed_at":"2026-07-28T08:18:05.872Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 325.066643] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:05.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64d2c1c766e45531480591c4","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64d2c1c766e45531480591c4: start","job_status":"start","queue_duration_s":3.347991,"scheduling_latency_s":3.348073}1475gitlab # [ 325.204217] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64d2c1c766e45531480591c4","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64d2c1c766e45531480591c4: done: 0.187029 sec","job_status":"done","queue_duration_s":3.347991,"scheduling_latency_s":3.348073,"redis_calls":13,"redis_duration_s":0.055211,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.011552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.043659,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.187029,"completed_at":"2026-07-28T08:18:06.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 325.278324] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc8007329f2ebf07c52464fe","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc8007329f2ebf07c52464fe: start","job_status":"start","queue_duration_s":3.560888,"scheduling_latency_s":3.560958}1477gitlab # [ 325.359967] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc8007329f2ebf07c52464fe","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc8007329f2ebf07c52464fe: done: 0.130003 sec","job_status":"done","queue_duration_s":3.560888,"scheduling_latency_s":3.560958,"redis_calls":13,"redis_duration_s":0.041522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.014059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.027463,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.130003,"completed_at":"2026-07-28T08:18:06.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 325.423230] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cb04531906922d2a531bc03","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cb04531906922d2a531bc03: start","job_status":"start","queue_duration_s":3.746549,"scheduling_latency_s":3.746597}1479gitlab # [ 325.560090] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cb04531906922d2a531bc03","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cb04531906922d2a531bc03: done: 0.145956 sec","job_status":"done","queue_duration_s":3.746549,"scheduling_latency_s":3.746597,"redis_calls":13,"redis_duration_s":0.028845999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.010038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.018808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.145956,"completed_at":"2026-07-28T08:18:06.435Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 325.629132] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba65322a6e0083740fd69965","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba65322a6e0083740fd69965: start","job_status":"start","queue_duration_s":3.91028,"scheduling_latency_s":3.910345}1481gitlab # [ 325.709135] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba65322a6e0083740fd69965","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba65322a6e0083740fd69965: done: 0.131668 sec","job_status":"done","queue_duration_s":3.91028,"scheduling_latency_s":3.910345,"redis_calls":13,"redis_duration_s":0.029498000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.010389,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.019109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.131668,"completed_at":"2026-07-28T08:18:06.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 325.762443] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2eb49fa3103efef4512a020","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2eb49fa3103efef4512a020: start","job_status":"start","queue_duration_s":4.057798,"scheduling_latency_s":4.057863}1483gitlab # [ 325.839801] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2eb49fa3103efef4512a020","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2eb49fa3103efef4512a020: done: 0.114154 sec","job_status":"done","queue_duration_s":4.057798,"scheduling_latency_s":4.057863,"redis_calls":13,"redis_duration_s":0.027645999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.010235,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017411,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.114154,"completed_at":"2026-07-28T08:18:06.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 325.890589] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c575518453dfc93b4ad5edf6","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c575518453dfc93b4ad5edf6: start","job_status":"start","queue_duration_s":4.187639,"scheduling_latency_s":4.187703}1485gitlab # [ 325.971113] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c575518453dfc93b4ad5edf6","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c575518453dfc93b4ad5edf6: done: 0.115255 sec","job_status":"done","queue_duration_s":4.187639,"scheduling_latency_s":4.187703,"redis_calls":13,"redis_duration_s":0.024873,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.010701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.115255,"completed_at":"2026-07-28T08:18:06.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 326.025795] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d9d9b79cdd0cab33adb8f61","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d9d9b79cdd0cab33adb8f61: start","job_status":"start","queue_duration_s":4.318229,"scheduling_latency_s":4.318288}1487gitlab # [ 326.091797] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d9d9b79cdd0cab33adb8f61","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d9d9b79cdd0cab33adb8f61: done: 0.107552 sec","job_status":"done","queue_duration_s":4.318229,"scheduling_latency_s":4.318288,"redis_calls":13,"redis_duration_s":0.0247,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.010431,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014269,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.107552,"completed_at":"2026-07-28T08:18:06.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 326.138163] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:06.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4824edab26b65c7ea95a8fc","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4824edab26b65c7ea95a8fc: start","job_status":"start","queue_duration_s":4.439103,"scheduling_latency_s":4.439175}1489gitlab # [ 326.235969] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4824edab26b65c7ea95a8fc","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4824edab26b65c7ea95a8fc: done: 0.130899 sec","job_status":"done","queue_duration_s":4.439103,"scheduling_latency_s":4.439175,"redis_calls":13,"redis_duration_s":0.063864,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.056824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.130899,"completed_at":"2026-07-28T08:18:07.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 326.343336] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf6d9fa38659f9af7277df0d","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf6d9fa38659f9af7277df0d: start","job_status":"start","queue_duration_s":4.676989,"scheduling_latency_s":4.677055}1491gitlab # [ 326.475505] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf6d9fa38659f9af7277df0d","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf6d9fa38659f9af7277df0d: done: 0.131971 sec","job_status":"done","queue_duration_s":4.676989,"scheduling_latency_s":4.677055,"redis_calls":13,"redis_duration_s":0.024835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.018276,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.131971,"completed_at":"2026-07-28T08:18:07.351Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 326.604466] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a882be5ba5317969d95a51e1","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a882be5ba5317969d95a51e1: start","job_status":"start","queue_duration_s":4.938169,"scheduling_latency_s":4.938236}1493gitlab # [ 326.715709] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a882be5ba5317969d95a51e1","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a882be5ba5317969d95a51e1: done: 0.110929 sec","job_status":"done","queue_duration_s":4.938169,"scheduling_latency_s":4.938236,"redis_calls":13,"redis_duration_s":0.027286,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.019505,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.110929,"completed_at":"2026-07-28T08:18:07.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 326.801831] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"342d44c06877a2493ff92166","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-342d44c06877a2493ff92166: start","job_status":"start","queue_duration_s":5.061289,"scheduling_latency_s":5.061357}1495gitlab # [ 326.852543] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"342d44c06877a2493ff92166","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-342d44c06877a2493ff92166: done: 0.123986 sec","job_status":"done","queue_duration_s":5.061289,"scheduling_latency_s":5.061357,"redis_calls":13,"redis_duration_s":0.043434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.015383,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.028051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.123986,"completed_at":"2026-07-28T08:18:07.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 326.924072] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92c238366a05a3933cefc7d7","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92c238366a05a3933cefc7d7: start","job_status":"start","queue_duration_s":5.195502,"scheduling_latency_s":5.195564}1497gitlab # [ 326.939048] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92c238366a05a3933cefc7d7","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92c238366a05a3933cefc7d7: done: 0.062696 sec","job_status":"done","queue_duration_s":5.195502,"scheduling_latency_s":5.195564,"redis_calls":13,"redis_duration_s":0.004301,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002647,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.062696,"completed_at":"2026-07-28T08:18:07.801Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 326.980700] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c752a1a8db208ed973ec031","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c752a1a8db208ed973ec031: start","job_status":"start","queue_duration_s":5.260917,"scheduling_latency_s":5.26096}1499gitlab # [ 326.993467] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c752a1a8db208ed973ec031","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c752a1a8db208ed973ec031: done: 0.065202 sec","job_status":"done","queue_duration_s":5.260917,"scheduling_latency_s":5.26096,"redis_calls":13,"redis_duration_s":0.004046,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002648,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.065202,"completed_at":"2026-07-28T08:18:07.869Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 327.034957] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a41c6dc3302061b2aeeffe2b","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a41c6dc3302061b2aeeffe2b: start","job_status":"start","queue_duration_s":5.330514,"scheduling_latency_s":5.330566}1501gitlab # [ 327.078276] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a41c6dc3302061b2aeeffe2b","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a41c6dc3302061b2aeeffe2b: done: 0.081431 sec","job_status":"done","queue_duration_s":5.330514,"scheduling_latency_s":5.330566,"redis_calls":13,"redis_duration_s":0.004819,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.081431,"completed_at":"2026-07-28T08:18:07.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 327.130801] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:07.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62522c24902492e607251769","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62522c24902492e607251769: start","job_status":"start","queue_duration_s":5.418697,"scheduling_latency_s":5.418758}1503gitlab # [ 327.157827] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62522c24902492e607251769","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62522c24902492e607251769: done: 0.071951 sec","job_status":"done","queue_duration_s":5.418697,"scheduling_latency_s":5.418758,"redis_calls":13,"redis_duration_s":0.0047220000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.071951,"completed_at":"2026-07-28T08:18:08.033Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 327.207593] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8c86545b2bb703761ea7db0","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8c86545b2bb703761ea7db0: start","job_status":"start","queue_duration_s":5.498952,"scheduling_latency_s":5.499011}1505gitlab # [ 327.261410] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8c86545b2bb703761ea7db0","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8c86545b2bb703761ea7db0: done: 0.095131 sec","job_status":"done","queue_duration_s":5.498952,"scheduling_latency_s":5.499011,"redis_calls":13,"redis_duration_s":0.009144,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.095131,"completed_at":"2026-07-28T08:18:08.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 327.336142] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcb256e3df95cba9f03d8216","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcb256e3df95cba9f03d8216: start","job_status":"start","queue_duration_s":5.670327,"scheduling_latency_s":5.670374}1507gitlab # [ 327.366677] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcb256e3df95cba9f03d8216","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcb256e3df95cba9f03d8216: done: 0.030483 sec","job_status":"done","queue_duration_s":5.670327,"scheduling_latency_s":5.670374,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001714,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030483,"completed_at":"2026-07-28T08:18:08.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 327.425852] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8f50f21b9ab68f58e303458","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8f50f21b9ab68f58e303458: start","job_status":"start","queue_duration_s":5.702987,"scheduling_latency_s":5.703025}1509gitlab # [ 327.444293] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8f50f21b9ab68f58e303458","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8f50f21b9ab68f58e303458: done: 0.026898 sec","job_status":"done","queue_duration_s":5.702987,"scheduling_latency_s":5.703025,"redis_calls":13,"redis_duration_s":0.002758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026898,"completed_at":"2026-07-28T08:18:08.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 327.490920] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d59faab5b2baae271310d46a","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d59faab5b2baae271310d46a: start","job_status":"start","queue_duration_s":5.731839,"scheduling_latency_s":5.731876}1511gitlab # [ 327.504298] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d59faab5b2baae271310d46a","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d59faab5b2baae271310d46a: done: 0.02542 sec","job_status":"done","queue_duration_s":5.731839,"scheduling_latency_s":5.731876,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001604,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02542,"completed_at":"2026-07-28T08:18:08.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 327.544843] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f103a415837ceab80f18b62","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f103a415837ceab80f18b62: start","job_status":"start","queue_duration_s":5.759636,"scheduling_latency_s":5.759672}1513gitlab # [ 327.557632] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f103a415837ceab80f18b62","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f103a415837ceab80f18b62: done: 0.025221 sec","job_status":"done","queue_duration_s":5.759636,"scheduling_latency_s":5.759672,"redis_calls":13,"redis_duration_s":0.0026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025221,"completed_at":"2026-07-28T08:18:08.327Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 327.597861] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09271cef2297847edccd84c3","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09271cef2297847edccd84c3: start","job_status":"start","queue_duration_s":5.786832,"scheduling_latency_s":5.786912}1515gitlab # [ 327.610674] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09271cef2297847edccd84c3","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09271cef2297847edccd84c3: done: 0.028209 sec","job_status":"done","queue_duration_s":5.786832,"scheduling_latency_s":5.786912,"redis_calls":13,"redis_duration_s":0.0033,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028209,"completed_at":"2026-07-28T08:18:08.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 327.652456] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0289ebfb8f48e06098cbdd19","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0289ebfb8f48e06098cbdd19: start","job_status":"start","queue_duration_s":5.817332,"scheduling_latency_s":5.817369}1517gitlab # [ 327.665230] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0289ebfb8f48e06098cbdd19","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0289ebfb8f48e06098cbdd19: done: 0.025407 sec","job_status":"done","queue_duration_s":5.817332,"scheduling_latency_s":5.817369,"redis_calls":13,"redis_duration_s":0.002649,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001687,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025407,"completed_at":"2026-07-28T08:18:08.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 327.705118] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"951ca5b0c3f2002c4c73db59","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-951ca5b0c3f2002c4c73db59: start","job_status":"start","queue_duration_s":5.845062,"scheduling_latency_s":5.845099}1519gitlab # [ 327.717814] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"951ca5b0c3f2002c4c73db59","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-951ca5b0c3f2002c4c73db59: done: 0.026596 sec","job_status":"done","queue_duration_s":5.845062,"scheduling_latency_s":5.845099,"redis_calls":14,"redis_duration_s":0.0027819999999999998,"redis_read_bytes":138,"redis_write_bytes":1216,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000219,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":59,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001572,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026596,"completed_at":"2026-07-28T08:18:08.414Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 327.759854] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b739f3e3ef3151f5a58a4c31","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b739f3e3ef3151f5a58a4c31: start","job_status":"start","queue_duration_s":5.873785,"scheduling_latency_s":5.873821}1521gitlab # [ 327.773053] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b739f3e3ef3151f5a58a4c31","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b739f3e3ef3151f5a58a4c31: done: 0.02726 sec","job_status":"done","queue_duration_s":5.873785,"scheduling_latency_s":5.873821,"redis_calls":15,"redis_duration_s":0.002946,"redis_read_bytes":266,"redis_write_bytes":1282,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000422,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":125,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001535,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02726,"completed_at":"2026-07-28T08:18:08.444Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 327.815066] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe954e6cb9c15765352a40a","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe954e6cb9c15765352a40a: start","job_status":"start","queue_duration_s":5.903203,"scheduling_latency_s":5.903241}1523gitlab # [ 327.828157] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe954e6cb9c15765352a40a","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe954e6cb9c15765352a40a: done: 0.026154 sec","job_status":"done","queue_duration_s":5.903203,"scheduling_latency_s":5.903241,"redis_calls":14,"redis_duration_s":0.002807,"redis_read_bytes":138,"redis_write_bytes":1269,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000322,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001546,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026154,"completed_at":"2026-07-28T08:18:08.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 327.871315] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31421c8a6201b5d5673fc94b","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31421c8a6201b5d5673fc94b: start","job_status":"start","queue_duration_s":5.931514,"scheduling_latency_s":5.931553}1525gitlab # [ 327.884253] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31421c8a6201b5d5673fc94b","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31421c8a6201b5d5673fc94b: done: 0.025789 sec","job_status":"done","queue_duration_s":5.931514,"scheduling_latency_s":5.931553,"redis_calls":13,"redis_duration_s":0.0026750000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001663,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025789,"completed_at":"2026-07-28T08:18:08.500Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 327.924999] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ff4d5f618cdab384744ebbf","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ff4d5f618cdab384744ebbf: start","job_status":"start","queue_duration_s":5.959724,"scheduling_latency_s":5.959764}1527gitlab # [ 327.937499] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ff4d5f618cdab384744ebbf","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ff4d5f618cdab384744ebbf: done: 0.025849 sec","job_status":"done","queue_duration_s":5.959724,"scheduling_latency_s":5.959764,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001692,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025849,"completed_at":"2026-07-28T08:18:08.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 327.977640] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc089adaf7375604c4ef57ec","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc089adaf7375604c4ef57ec: start","job_status":"start","queue_duration_s":5.987867,"scheduling_latency_s":5.987905}1529gitlab # [ 327.990350] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc089adaf7375604c4ef57ec","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc089adaf7375604c4ef57ec: done: 0.026512 sec","job_status":"done","queue_duration_s":5.987867,"scheduling_latency_s":5.987905,"redis_calls":13,"redis_duration_s":0.002777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026512,"completed_at":"2026-07-28T08:18:08.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 328.029537] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f8f984f9f8bd28d1d938fe5","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f8f984f9f8bd28d1d938fe5: start","job_status":"start","queue_duration_s":6.016754,"scheduling_latency_s":6.016793}1531gitlab # [ 328.043267] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f8f984f9f8bd28d1d938fe5","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f8f984f9f8bd28d1d938fe5: done: 0.025646 sec","job_status":"done","queue_duration_s":6.016754,"scheduling_latency_s":6.016793,"redis_calls":13,"redis_duration_s":0.00263,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001666,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025646,"completed_at":"2026-07-28T08:18:08.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 328.084177] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4812240b14d1aaa9ac8c8ad0","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4812240b14d1aaa9ac8c8ad0: start","job_status":"start","queue_duration_s":6.044705,"scheduling_latency_s":6.044746}1533gitlab # [ 328.096782] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4812240b14d1aaa9ac8c8ad0","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4812240b14d1aaa9ac8c8ad0: done: 0.025225 sec","job_status":"done","queue_duration_s":6.044705,"scheduling_latency_s":6.044746,"redis_calls":13,"redis_duration_s":0.002558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001613,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025225,"completed_at":"2026-07-28T08:18:08.612Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 328.136858] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37788a114348358703d0e1de","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37788a114348358703d0e1de: start","job_status":"start","queue_duration_s":6.071804,"scheduling_latency_s":6.071838}1535gitlab # [ 328.149696] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37788a114348358703d0e1de","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37788a114348358703d0e1de: done: 0.02551 sec","job_status":"done","queue_duration_s":6.071804,"scheduling_latency_s":6.071838,"redis_calls":13,"redis_duration_s":0.002954,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02551,"completed_at":"2026-07-28T08:18:08.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 328.190461] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4ca330887c1a42128b98ec5","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4ca330887c1a42128b98ec5: start","job_status":"start","queue_duration_s":6.099297,"scheduling_latency_s":6.099334}1537gitlab # [ 328.203316] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4ca330887c1a42128b98ec5","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4ca330887c1a42128b98ec5: done: 0.030764 sec","job_status":"done","queue_duration_s":6.099297,"scheduling_latency_s":6.099334,"redis_calls":13,"redis_duration_s":0.0027210000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030764,"completed_at":"2026-07-28T08:18:08.673Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 328.243951] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2135db86fd463c1ca33eff54","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2135db86fd463c1ca33eff54: start","job_status":"start","queue_duration_s":6.132483,"scheduling_latency_s":6.132521}1539gitlab # [ 328.258231] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2135db86fd463c1ca33eff54","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2135db86fd463c1ca33eff54: done: 0.025656 sec","job_status":"done","queue_duration_s":6.132483,"scheduling_latency_s":6.132521,"redis_calls":13,"redis_duration_s":0.002726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025656,"completed_at":"2026-07-28T08:18:08.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 328.298487] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1942677142e32b22a6eb6a","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1942677142e32b22a6eb6a: start","job_status":"start","queue_duration_s":6.160151,"scheduling_latency_s":6.160191}1541gitlab # [ 328.311396] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1942677142e32b22a6eb6a","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1942677142e32b22a6eb6a: done: 0.025964 sec","job_status":"done","queue_duration_s":6.160151,"scheduling_latency_s":6.160191,"redis_calls":13,"redis_duration_s":0.002665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025964,"completed_at":"2026-07-28T08:18:08.729Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 328.352082] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f36adbae355a25c2f2977bf","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f36adbae355a25c2f2977bf: start","job_status":"start","queue_duration_s":6.187889,"scheduling_latency_s":6.187926}1543gitlab # [ 328.364913] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f36adbae355a25c2f2977bf","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f36adbae355a25c2f2977bf: done: 0.025626 sec","job_status":"done","queue_duration_s":6.187889,"scheduling_latency_s":6.187926,"redis_calls":13,"redis_duration_s":0.002935,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025626,"completed_at":"2026-07-28T08:18:08.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 328.404876] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f04cf6396db658f4884eef6c","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f04cf6396db658f4884eef6c: start","job_status":"start","queue_duration_s":6.215469,"scheduling_latency_s":6.215505}1545gitlab # [ 328.417319] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:08.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f04cf6396db658f4884eef6c","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f04cf6396db658f4884eef6c: done: 0.238678 sec","job_status":"done","queue_duration_s":6.215469,"scheduling_latency_s":6.215505,"redis_calls":13,"redis_duration_s":0.003154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.238678,"completed_at":"2026-07-28T08:18:08.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 328.458848] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7422e7ac77a06f4e4d1bb96f","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7422e7ac77a06f4e4d1bb96f: start","job_status":"start","queue_duration_s":6.45755,"scheduling_latency_s":6.45759}1547gitlab # [ 328.471602] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7422e7ac77a06f4e4d1bb96f","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7422e7ac77a06f4e4d1bb96f: done: 0.025512 sec","job_status":"done","queue_duration_s":6.45755,"scheduling_latency_s":6.45759,"redis_calls":13,"redis_duration_s":0.002473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001541,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025512,"completed_at":"2026-07-28T08:18:09.026Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 328.512049] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"769b5a4d12b186046cb7cd67","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-769b5a4d12b186046cb7cd67: start","job_status":"start","queue_duration_s":6.485031,"scheduling_latency_s":6.485067}1549gitlab # [ 328.524699] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"769b5a4d12b186046cb7cd67","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-769b5a4d12b186046cb7cd67: done: 0.025293 sec","job_status":"done","queue_duration_s":6.485031,"scheduling_latency_s":6.485067,"redis_calls":13,"redis_duration_s":0.002914,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025293,"completed_at":"2026-07-28T08:18:09.053Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 328.565682] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0762a1a04371c8cf43fce4ec","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0762a1a04371c8cf43fce4ec: start","job_status":"start","queue_duration_s":6.512255,"scheduling_latency_s":6.512291}1551gitlab # [ 328.578851] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0762a1a04371c8cf43fce4ec","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0762a1a04371c8cf43fce4ec: done: 0.024928 sec","job_status":"done","queue_duration_s":6.512255,"scheduling_latency_s":6.512291,"redis_calls":13,"redis_duration_s":0.002482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001472,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024928,"completed_at":"2026-07-28T08:18:09.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 328.621293] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67b1a5b39582ce7414290121","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67b1a5b39582ce7414290121: start","job_status":"start","queue_duration_s":6.539126,"scheduling_latency_s":6.539162}1553gitlab # [ 328.634471] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67b1a5b39582ce7414290121","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67b1a5b39582ce7414290121: done: 0.025663 sec","job_status":"done","queue_duration_s":6.539126,"scheduling_latency_s":6.539162,"redis_calls":13,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001781,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025663,"completed_at":"2026-07-28T08:18:09.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 328.676920] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"011e9380a8fe844f1df7a523","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-011e9380a8fe844f1df7a523: start","job_status":"start","queue_duration_s":6.568271,"scheduling_latency_s":6.568311}1555gitlab # [ 328.689539] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"011e9380a8fe844f1df7a523","created_at":"2026-07-28T08:18:01.789Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-8b770c39b4174eaf","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d893d4247c17a042ea302589e1e2905a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.543Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-011e9380a8fe844f1df7a523: done: 0.025603 sec","job_status":"done","queue_duration_s":6.568271,"scheduling_latency_s":6.568311,"redis_calls":13,"redis_duration_s":0.002516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001463,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025603,"completed_at":"2026-07-28T08:18:09.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 328.729930] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"52a5a06e8fd20e298d78376c","created_at":"2026-07-28T08:18:02.545Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8162e41ba49e109264c72d9e3a069ab","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.616Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-52a5a06e8fd20e298d78376c: start","job_status":"start","queue_duration_s":6.52215,"scheduling_latency_s":6.522187}1557gitlab # [ 328.745049] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:09.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"52a5a06e8fd20e298d78376c","created_at":"2026-07-28T08:18:02.545Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8162e41ba49e109264c72d9e3a069ab","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:02.616Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-52a5a06e8fd20e298d78376c: done: 0.049983 sec","job_status":"done","queue_duration_s":6.52215,"scheduling_latency_s":6.522187,"redis_calls":10,"redis_duration_s":0.0029820000000000003,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00068,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00173,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037624,"duration_s":0.049983,"completed_at":"2026-07-28T08:18:09.188Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 375.296816] runuser[3657]: pam_unix(runuser:session): session closed for user gitlab1559gitlab # [ 375.301798] setup-gitlab-start[4124]: ++ jq -r .token1560gitlab # [ 375.304649] setup-gitlab-start[4125]: +++ date -d '+7 days' +%F1561gitlab # [ 375.308184] setup-gitlab-start[4123]: ++ curl -fs -X POST -H 'Authorization: Bearer f1837b50064f5a7fe1697129ab630dbd44800a1192563705c7a9e750df6b58c5' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-08-04"}' http://gitlab/api/v4/users/1/personal_access_tokens1562gitlab # [ 376.167227] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:57.042Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"66bbdd5e3f53428b7d346075","created_at":"2026-07-28T08:18:56.989Z","trace_propagation_headers":{"sentry-trace":"4101292b5ae444259c4c14323725c656-395f930e52b44c40","baggage":"sentry-trace_id=4101292b5ae444259c4c14323725c656,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWCJGD508F89N2VSYQRW5","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:3a632123e127d48afd25738715c661884812a5934efac71dd77cc77811555017","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:57.037Z","job_size_bytes":451,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-66bbdd5e3f53428b7d346075: start","job_status":"start","queue_duration_s":0.00512,"scheduling_latency_s":0.005194}1563gitlab # [ 376.195448] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:18:57 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 8621564gitlab # [ 376.218364] setup-gitlab-start[3596]: + TOKEN=glpat-R6qAeooyiAR60ObnHZkZtW86MQp1OjEH.01.0w0rjb5ji1565gitlab # [ 376.222671] setup-gitlab-start[3596]: + test -n glpat-R6qAeooyiAR60ObnHZkZtW86MQp1OjEH.01.0w0rjb5ji1566gitlab # [ 376.224074] setup-gitlab-start[3596]: + test glpat-R6qAeooyiAR60ObnHZkZtW86MQp1OjEH.01.0w0rjb5ji '!=' null1567gitlab # [ 376.225534] setup-gitlab-start[3596]: + mkdir -p /var/lib/secrets1568gitlab # [ 376.226484] setup-gitlab-start[3596]: + echo glpat-R6qAeooyiAR60ObnHZkZtW86MQp1OjEH.01.0w0rjb5ji1569gitlab # [ 376.227785] setup-gitlab-start[3596]: + chmod 644 /var/lib/secrets/gitlab-token1570gitlab # [ 376.229549] setup-gitlab-start[3596]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-R6qAeooyiAR60ObnHZkZtW86MQp1OjEH.01.0w0rjb5ji' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1571gitlab # [ 376.497880] sidekiq-cluster[2497]: {"severity":"WARN","time":"2026-07-28T08:18:57.372Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"66bbdd5e3f53428b7d346075","created_at":"2026-07-28T08:18:56.989Z","trace_propagation_headers":{"sentry-trace":"4101292b5ae444259c4c14323725c656-395f930e52b44c40","baggage":"sentry-trace_id=4101292b5ae444259c4c14323725c656,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWCJGD508F89N2VSYQRW5","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:3a632123e127d48afd25738715c661884812a5934efac71dd77cc77811555017","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:57.037Z","job_size_bytes":451,"pid":2497,"sidekiq_tid":"lyop","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-66bbdd5e3f53428b7d346075: fail: 0.328823 sec","job_status":"fail","queue_duration_s":0.00512,"scheduling_latency_s":0.005194,"redis_calls":13,"redis_duration_s":0.010316,"redis_read_bytes":139,"redis_write_bytes":1582,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.005265,"redis_feature_flag_read_bytes":132,"redis_feature_flag_write_bytes":698,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001234,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.236531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00116572,"duration_s":0.328823,"completed_at":"2026-07-28T08:18:57.370Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/w9mp1gyfs2qdv12r0ji70idzndmxwz2s-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/p8ylyr0sj9sxcknqcpja13nypqixk2dp-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/dndr7b4a17339dsm67vzb6nv4p2kp82q-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/zx6ndpscxs64hnidz69ab430ccms6rak-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.066963,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 378.157004] gitaly[1368]: time="2026-07-28T08:18:59.033Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:09.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:18:59.032" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1573gitlab # [ 378.157531] gitaly[1368]: time="2026-07-28T08:18:59.033Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:09.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:18:59.032" grpc.time_ms=0.735 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1574gitlab # [ 378.831104] gitaly[1368]: time="2026-07-28T08:18:59.708Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:09.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:18:59.708" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 378.831688] gitaly[1368]: time="2026-07-28T08:18:59.709Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:09.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:18:59.708" grpc.time_ms=0.586 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1576gitlab # [ 378.892209] gitaly[1368]: time="2026-07-28T08:18:59.769Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB diskcache=055bd72f-658a-46e5-b4fa-0eb267b04c39 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-28T08:19:09.033" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:18:59.733" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1577gitlab # [ 378.931692] gitaly[1368]: time="2026-07-28T08:18:59.770Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=32 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-28T08:19:09.033" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:18:59.733" grpc.time_ms=36.32 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1578gitlab # [ 378.958281] gitaly[1368]: time="2026-07-28T08:18:59.831Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:09.129" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:18:59.829" pid=1368 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1579gitlab # [ 378.973891] gitaly[1368]: time="2026-07-28T08:18:59.831Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:09.129" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:18:59.829" grpc.time_ms=1.617 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1580gitlab # [ 378.992156] gitaly[1368]: time="2026-07-28T08:18:59.869Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-28T08:19:09.149" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:18:59.850" grpc.time_ms=19.214 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1581gitlab # [ 379.075724] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:18:59.951Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6d69a6cb29a6ecb5b828f1d6","created_at":"2026-07-28T08:18:59.902Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:59.948Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6d69a6cb29a6ecb5b828f1d6: start","job_status":"start","queue_duration_s":0.003515,"scheduling_latency_s":0.003591}1582gitlab # [ 379.159761] gitaly[1368]: time="2026-07-28T08:19:00.036Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:10.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:00.035" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 379.192749] gitaly[1368]: time="2026-07-28T08:19:00.036Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:10.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:00.035" grpc.time_ms=0.666 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 379.229135] gitaly[1368]: time="2026-07-28T08:19:00.096Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB diskcache=a35379ec-4def-4647-b22a-7828deefdc83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-28T08:19:10.027" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:00.058" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 379.253093] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:00.090Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6d69a6cb29a6ecb5b828f1d6","created_at":"2026-07-28T08:18:59.902Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-28T08:18:59.948Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6d69a6cb29a6ecb5b828f1d6: done: 0.139298 sec","job_status":"done","queue_duration_s":0.003515,"scheduling_latency_s":0.003591,"redis_calls":13,"redis_duration_s":0.009849,"redis_read_bytes":138,"redis_write_bytes":1593,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001561,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":428,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002629,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07186788,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.139298,"completed_at":"2026-07-28T08:19:00.090Z","load_balancing_strategy":"primary","db_duration_s":0.019456,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1586gitlab # [ 379.321354] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:00.094Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"03b4ca5f91f628459e221c8b","created_at":"2026-07-28T08:18:59.992Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:00.018Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-03b4ca5f91f628459e221c8b: start","job_status":"start","queue_duration_s":0.07554,"scheduling_latency_s":0.075587}1587gitlab # [ 379.339645] gitaly[1368]: time="2026-07-28T08:19:00.097Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=298 command.oublock=32 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-28T08:19:10.027" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:00.058" grpc.time_ms=38.859 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1588gitlab # [ 379.355186] gitaly[1368]: time="2026-07-28T08:19:00.119Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:10.084" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:00.118" pid=1368 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1589gitlab # [ 379.367700] gitaly[1368]: time="2026-07-28T08:19:00.119Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:10.084" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:00.118" grpc.time_ms=0.984 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 379.380199] gitaly[1368]: time="2026-07-28T08:19:00.150Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=5 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-28T08:19:10.100" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:00.130" grpc.time_ms=19.186 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 379.394423] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:00.261Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"03b4ca5f91f628459e221c8b","created_at":"2026-07-28T08:18:59.992Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:00.018Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-03b4ca5f91f628459e221c8b: done: 0.167181 sec","job_status":"done","queue_duration_s":0.07554,"scheduling_latency_s":0.075587,"redis_calls":14,"redis_duration_s":0.0055969999999999995,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001218,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002446,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12051796000000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.167181,"completed_at":"2026-07-28T08:19:00.261Z","load_balancing_strategy":"primary","db_duration_s":0.035754,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1592gitlab # [ 379.441055] gitaly[1368]: time="2026-07-28T08:19:00.276Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:10.245" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:00.276" grpc.time_ms=0.37 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 379.452256] gitaly[1368]: time="2026-07-28T08:19:00.319Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-28T08:19:10.288" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:00.319" grpc.time_ms=0.491 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 380.948706] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:01.824Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"d05ef9a9d90768f7a7492076","created_at":"2026-07-28T08:19:01.811Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:01.822Z","job_size_bytes":5,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-d05ef9a9d90768f7a7492076: start","job_status":"start","queue_duration_s":0.002058,"scheduling_latency_s":0.002103}1595gitlab # [ 381.127342] gitaly[1368]: time="2026-07-28T08:19:02.004Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWDFDZ333AF1KT9FR2XRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-28T08:19:11.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:01.988" grpc.time_ms=15.705 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 381.253117] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:02.129Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"d05ef9a9d90768f7a7492076","created_at":"2026-07-28T08:19:01.811Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:01.822Z","job_size_bytes":5,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-d05ef9a9d90768f7a7492076: done: 0.304834 sec","job_status":"done","queue_duration_s":0.002058,"scheduling_latency_s":0.002103,"redis_calls":21,"redis_duration_s":0.011859,"redis_read_bytes":782,"redis_write_bytes":2429,"redis_feature_flag_calls":12,"redis_feature_flag_duration_s":0.005597,"redis_feature_flag_read_bytes":774,"redis_feature_flag_write_bytes":1379,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005163,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":16,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.235467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00130984,"duration_s":0.304834,"completed_at":"2026-07-28T08:19:02.129Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046154,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1597gitlab # [ 381.341285] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:02.135Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"205e8344bcfdee419db0624d","created_at":"2026-07-28T08:19:01.905Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:01.921Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-205e8344bcfdee419db0624d: start","job_status":"start","queue_duration_s":0.213415,"scheduling_latency_s":0.213481}1598gitlab # [ 381.808384] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:02.685Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"205e8344bcfdee419db0624d","created_at":"2026-07-28T08:19:01.905Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:01.921Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-205e8344bcfdee419db0624d: done: 0.550389 sec","job_status":"done","queue_duration_s":0.213415,"scheduling_latency_s":0.213481,"redis_calls":11,"redis_duration_s":0.005944,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001853,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.448,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.448,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.411684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00073948,"duration_s":0.550389,"completed_at":"2026-07-28T08:19:02.685Z","load_balancing_strategy":"primary","db_duration_s":0.13828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 381.901751] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:02.729Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"796547a2cedbf6105fc3f968","created_at":"2026-07-28T08:19:01.930Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:01.947Z","job_size_bytes":89,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-796547a2cedbf6105fc3f968: start","job_status":"start","queue_duration_s":0.781905,"scheduling_latency_s":0.781965}1600gitlab # [ 381.963473] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:02 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 57061601gitlab # [ 381.966779] setup-gitlab-start[3596]: + mkdir -p /tmp/test-flake1602gitlab # [ 381.972349] setup-gitlab-start[3596]: + cd /tmp/test-flake1603gitlab # [ 381.974132] setup-gitlab-start[3596]: + git init -b master1604gitlab # [ 382.016424] setup-gitlab-start[4181]: Initialized empty Git repository in /tmp/test-flake/.git/1605gitlab # [ 382.020207] setup-gitlab-start[3596]: + git config user.name test1606gitlab # [ 382.027714] setup-gitlab-start[3596]: + git config user.email test@example.com1607gitlab # [ 382.035427] setup-gitlab-start[3596]: + cat1608gitlab # [ 382.042308] setup-gitlab-start[3596]: + git add flake.nix1609gitlab # [ 382.051937] setup-gitlab-start[3596]: + git commit -m 'initial commit'1610gitlab # [ 382.058288] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:02.933Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"796547a2cedbf6105fc3f968","created_at":"2026-07-28T08:19:01.930Z","trace_propagation_headers":{"sentry-trace":"eb02edb11d44450e9517b7176b7de909-ec264a48072f44c2","baggage":"sentry-trace_id=eb02edb11d44450e9517b7176b7de909,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWDFDZ333AF1KT9FR2XRB","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:01.947Z","job_size_bytes":89,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-796547a2cedbf6105fc3f968: done: 0.203628 sec","job_status":"done","queue_duration_s":0.781905,"scheduling_latency_s":0.781965,"redis_calls":11,"redis_duration_s":0.007424,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001481,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003969,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001974,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.126325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0013206,"duration_s":0.203628,"completed_at":"2026-07-28T08:19:02.933Z","load_balancing_strategy":"primary","db_duration_s":0.057956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 382.158170] setup-gitlab-start[4186]: [master (root-commit) 0c133b5] initial commit1612gitlab # [ 382.159627] setup-gitlab-start[4186]: 1 file changed, 10 insertions(+)1613gitlab # [ 382.160975] setup-gitlab-start[4186]: create mode 100644 flake.nix1614gitlab # [ 382.162112] setup-gitlab-start[3596]: + git remote add origin http://oauth2:glpat-R6qAeooyiAR60ObnHZkZtW86MQp1OjEH.01.0w0rjb5ji@gitlab/root/test-flake.git1615gitlab # [ 382.164528] setup-gitlab-start[3596]: + git push -u origin master1616gitlab # [ 382.425720] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 2841617gitlab # [ 382.727784] gitaly[1368]: time="2026-07-28T08:19:03.603Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKG8MTBEVDK3NMWC17KM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:03.582" grpc.time_ms=21.375 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1618gitlab # [ 382.768507] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 2991619gitlab # [ 383.199893] gitaly[1368]: time="2026-07-28T08:19:04.077Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-28T08:19:14.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:04.057" grpc.time_ms=19.431 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 383.305912] gitaly[1368]: time="2026-07-28T08:19:04.183Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-28T08:19:34.058" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-28T08:19:04.159" grpc.time_ms=23.996 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 383.371583] gitaly[1368]: time="2026-07-28T08:19:04.249Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY duration_ms=360ns method=POST pid=1368 status=200 url="http://unix/api/v4/internal/allowed"1622gitlab # [ 383.412693] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:04.288Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"171f2b31371eb018a7b9d77f","created_at":"2026-07-28T08:19:04.262Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.285Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-171f2b31371eb018a7b9d77f: start","job_status":"start","queue_duration_s":0.002652,"scheduling_latency_s":0.00272}1623gitlab # [ 383.482819] gitaly[1368]: time="2026-07-28T08:19:04.359Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY duration_ms=109ns method=POST pid=1368 status=200 url="http://unix/api/v4/internal/pre_receive"1624gitlab # [ 383.492436] gitaly[1368]: time="2026-07-28T08:19:04.360Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5317 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:03.887" grpc.time_ms=472.983 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 383.527966] gitaly[1368]: time="2026-07-28T08:19:04.405Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:04.404" grpc.time_ms=0.868 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1626gitlab # [ 383.575664] gitaly[1368]: time="2026-07-28T08:19:04.453Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:04.452" grpc.time_ms=0.703 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1627gitlab # [ 383.634773] gitaly[1368]: time="2026-07-28T08:19:04.512Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:04.511" grpc.time_ms=0.825 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1628gitlab # [ 383.659856] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:04.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"171f2b31371eb018a7b9d77f","created_at":"2026-07-28T08:19:04.262Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.285Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-171f2b31371eb018a7b9d77f: done: 0.236564 sec","job_status":"done","queue_duration_s":0.002652,"scheduling_latency_s":0.00272,"redis_calls":18,"redis_duration_s":0.047706,"redis_read_bytes":19,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002005,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.005363,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.038284,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002054,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.236564,"completed_at":"2026-07-28T08:19:04.524Z","load_balancing_strategy":"primary","db_duration_s":0.008106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 383.717588] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:04.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"eac1cdd747eb360b718e8072","created_at":"2026-07-28T08:19:04.301Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c48a68ad79ab71ac653423bfae70832","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.315Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-eac1cdd747eb360b718e8072: start","job_status":"start","queue_duration_s":0.22805,"scheduling_latency_s":0.228097}1630gitlab # [ 383.769141] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:04.646Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1631gitlab # [ 383.836904] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:04.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"eac1cdd747eb360b718e8072","created_at":"2026-07-28T08:19:04.301Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c48a68ad79ab71ac653423bfae70832","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.315Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-eac1cdd747eb360b718e8072: done: 0.169901 sec","job_status":"done","queue_duration_s":0.22805,"scheduling_latency_s":0.228097,"redis_calls":9,"redis_duration_s":0.035865,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.012576,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.01355,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.169901,"completed_at":"2026-07-28T08:19:04.713Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 383.882485] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:04.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b68b4f23a68a0f20883757fb","created_at":"2026-07-28T08:19:04.324Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5985bdbb7dca8484d0ba1c297f2526f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.343Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b68b4f23a68a0f20883757fb: start","job_status":"start","queue_duration_s":0.377395,"scheduling_latency_s":0.377446}1633gitlab # [ 383.909964] gitaly[1368]: time="2026-07-28T08:19:04.787Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-28T08:19:14.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:04.774" grpc.time_ms=12.709 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1634gitlab # [ 383.957235] gitaly[1368]: time="2026-07-28T08:19:04.834Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-28T08:19:14.035" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:04.805" grpc.time_ms=28.8 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1635gitlab # [ 383.972112] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:04.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b68b4f23a68a0f20883757fb","created_at":"2026-07-28T08:19:04.324Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5985bdbb7dca8484d0ba1c297f2526f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.343Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b68b4f23a68a0f20883757fb: done: 0.114038 sec","job_status":"done","queue_duration_s":0.377395,"scheduling_latency_s":0.377446,"redis_calls":13,"redis_duration_s":0.008112,"redis_read_bytes":11,"redis_write_bytes":1663,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.004991,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":887,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002275,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.114038,"completed_at":"2026-07-28T08:19:04.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023531,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 384.017486] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:04.847Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"90b2204b9c1498f3f804fb6a","created_at":"2026-07-28T08:19:04.352Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.403Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-90b2204b9c1498f3f804fb6a: start","job_status":"start","queue_duration_s":0.443328,"scheduling_latency_s":0.443376}1637gitlab # [ 384.032418] gitlab-workhorse[1293]: time="2026-07-28T08:19:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521638gitlab # [ 384.034442] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:04 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 12711639gitlab # [ 384.036806] systemd[1]: Finished setup-gitlab.service.1640gitlab # [ 384.037819] setup-gitlab-start[4190]: To http://gitlab/root/test-flake.git1641gitlab # [ 384.038781] setup-gitlab-start[4190]: * [new branch] master -> master1642gitlab # [ 384.039742] setup-gitlab-start[4190]: branch 'master' set up to track 'origin/master'.1643gitlab # [ 384.040907] gitaly[1368]: time="2026-07-28T08:19:04.863Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY duration_ms=297ns method=POST pid=1368 status=200 url="http://unix/api/v4/internal/post_receive"1644gitlab # [ 384.043983] gitaly[1368]: time="2026-07-28T08:19:04.865Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4811 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:04.565" grpc.time_ms=300.269 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1645gitlab # [ 384.055809] gitaly[1368]: time="2026-07-28T08:19:04.890Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY diskcache=0f3e1709-40c8-4577-8f84-95c23c2237a1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:03.767" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1646gitlab # [ 384.066423] systemd[1]: Starting nixbot CI service...1647gitlab # [ 384.067324] gitaly[1368]: time="2026-07-28T08:19:04.891Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=268 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13405 command.oublock=32 command.real_time_ms=1106 command.spawn_token_fork_ms=2 command.system_time_ms=180 command.user_time_ms=88 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:03.767" grpc.time_ms=1122.993 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1648gitlab: (finished: waiting for unit setup-gitlab.service, in 385.04 seconds)1649gitlab: waiting for unit nixbot.service1650gitlab # [ 384.562744] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"90b2204b9c1498f3f804fb6a","created_at":"2026-07-28T08:19:04.352Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.403Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-90b2204b9c1498f3f804fb6a: done: 0.59148 sec","job_status":"done","queue_duration_s":0.443328,"scheduling_latency_s":0.443376,"redis_calls":62,"redis_duration_s":0.165459,"redis_read_bytes":110,"redis_write_bytes":41440,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003226,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_calls":2,"redis_queues_duration_s":0.000884,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.155007,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.006342,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.249479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.59148,"completed_at":"2026-07-28T08:19:05.438Z","load_balancing_strategy":"primary","db_duration_s":0.016302,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 384.683988] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.441Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b76282e7e6b1dc0ef5e1d067","created_at":"2026-07-28T08:19:04.408Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-2c19ad0143234a95","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.480Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b76282e7e6b1dc0ef5e1d067: start","job_status":"start","queue_duration_s":0.960918,"scheduling_latency_s":0.960955}1652gitlab # [ 384.711943] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.476Z","message":"No existing merge request to be cleaned up."}1653gitlab # [ 384.715407] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.493Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b76282e7e6b1dc0ef5e1d067","created_at":"2026-07-28T08:19:04.408Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-2c19ad0143234a95","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.480Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b76282e7e6b1dc0ef5e1d067: done: 0.052151 sec","job_status":"done","queue_duration_s":0.960918,"scheduling_latency_s":0.960955,"redis_calls":12,"redis_duration_s":0.005796,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00096,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001443,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003393,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052151,"completed_at":"2026-07-28T08:19:05.493Z","load_balancing_strategy":"primary","db_duration_s":0.014081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 384.780861] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.495Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e1b5103e55a934221530167d","created_at":"2026-07-28T08:19:04.408Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-2c19ad0143234a95","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.480Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e1b5103e55a934221530167d: start","job_status":"start","queue_duration_s":1.015351,"scheduling_latency_s":1.015394}1655gitlab # [ 384.799238] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.519Z","message":"No existing merge request to be cleaned up."}1656gitlab # [ 384.801783] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.550Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e1b5103e55a934221530167d","created_at":"2026-07-28T08:19:04.408Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-2c19ad0143234a95","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.480Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e1b5103e55a934221530167d: done: 0.054987 sec","job_status":"done","queue_duration_s":1.015351,"scheduling_latency_s":1.015394,"redis_calls":10,"redis_duration_s":0.004809,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002754,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054987,"completed_at":"2026-07-28T08:19:05.550Z","load_balancing_strategy":"primary","db_duration_s":0.01038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 384.850315] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.555Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f0a7bb93cdabbf6fd670c32f","created_at":"2026-07-28T08:19:04.408Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-2c19ad0143234a95","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.480Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f0a7bb93cdabbf6fd670c32f: start","job_status":"start","queue_duration_s":1.075329,"scheduling_latency_s":1.075396}1658gitlab # [ 384.863823] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.590Z","message":"No existing merge request to be cleaned up."}1659gitlab # [ 384.865779] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.614Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f0a7bb93cdabbf6fd670c32f","created_at":"2026-07-28T08:19:04.408Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-2c19ad0143234a95","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.480Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f0a7bb93cdabbf6fd670c32f: done: 0.059266 sec","job_status":"done","queue_duration_s":1.075329,"scheduling_latency_s":1.075396,"redis_calls":10,"redis_duration_s":0.005674,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003064,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059266,"completed_at":"2026-07-28T08:19:05.614Z","load_balancing_strategy":"primary","db_duration_s":0.00489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 384.908554] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.618Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4db6745469478570e8819140","created_at":"2026-07-28T08:19:04.408Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-2c19ad0143234a95","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.480Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4db6745469478570e8819140: start","job_status":"start","queue_duration_s":1.137627,"scheduling_latency_s":1.137708}1661gitlab # [ 384.922527] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.642Z","message":"No existing merge request to be cleaned up."}1662gitlab # [ 384.924597] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.661Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4db6745469478570e8819140","created_at":"2026-07-28T08:19:04.408Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-2c19ad0143234a95","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"36d7b83fa865da7425a2c957f96c092a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.480Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4db6745469478570e8819140: done: 0.043465 sec","job_status":"done","queue_duration_s":1.137627,"scheduling_latency_s":1.137708,"redis_calls":10,"redis_duration_s":0.004521,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002651,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043465,"completed_at":"2026-07-28T08:19:05.661Z","load_balancing_strategy":"primary","db_duration_s":0.00388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663gitlab # [ 384.967443] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f375595530beae931511cd39","created_at":"2026-07-28T08:19:04.468Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"466705ef7a0eee592068fdd9f7179075","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.496Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f375595530beae931511cd39: start","job_status":"start","queue_duration_s":1.168439,"scheduling_latency_s":1.168485}1664gitlab # [ 384.982799] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f375595530beae931511cd39","created_at":"2026-07-28T08:19:04.468Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"466705ef7a0eee592068fdd9f7179075","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.496Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f375595530beae931511cd39: done: 0.041566 sec","job_status":"done","queue_duration_s":1.168439,"scheduling_latency_s":1.168485,"redis_calls":9,"redis_duration_s":0.004171,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000944,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002378,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.041566,"completed_at":"2026-07-28T08:19:05.706Z","load_balancing_strategy":"primary","db_duration_s":0.005144,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665gitlab # [ 385.031326] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.709Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9eb31ca26c025fca22a8bf88","created_at":"2026-07-28T08:19:04.514Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b495bdf47b70d37bd9a0bd08ad7c308a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.532Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9eb31ca26c025fca22a8bf88: start","job_status":"start","queue_duration_s":1.176778,"scheduling_latency_s":1.176818}1666gitlab # [ 385.048087] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.731Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1667gitlab # [ 385.052264] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9eb31ca26c025fca22a8bf88","created_at":"2026-07-28T08:19:04.514Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b495bdf47b70d37bd9a0bd08ad7c308a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.532Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9eb31ca26c025fca22a8bf88: done: 0.032329 sec","job_status":"done","queue_duration_s":1.176778,"scheduling_latency_s":1.176818,"redis_calls":9,"redis_duration_s":0.003639,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000926,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032329,"completed_at":"2026-07-28T08:19:05.741Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001082,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 385.101716] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e01be8efda9d45ecaac1d097","created_at":"2026-07-28T08:19:04.541Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20184a86624bcd9800bb859b49caa0c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.563Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e01be8efda9d45ecaac1d097: start","job_status":"start","queue_duration_s":1.181176,"scheduling_latency_s":1.181213}1669gitlab # [ 385.117380] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e01be8efda9d45ecaac1d097","created_at":"2026-07-28T08:19:04.541Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20184a86624bcd9800bb859b49caa0c0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.563Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e01be8efda9d45ecaac1d097: done: 0.079452 sec","job_status":"done","queue_duration_s":1.181176,"scheduling_latency_s":1.181213,"redis_calls":11,"redis_duration_s":0.005862,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001309,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00226,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00163932,"exclusive_lock_hold_duration_s":0.02820556,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.079452,"completed_at":"2026-07-28T08:19:05.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027805,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 385.163838] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b0f00a191cf43482b610427b","created_at":"2026-07-28T08:19:04.604Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9147f379ff4f4181a36ebbc9d3c1a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.636Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b0f00a191cf43482b610427b: start","job_status":"start","queue_duration_s":1.190377,"scheduling_latency_s":1.190421}1671gitlab # [ 385.179148] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b0f00a191cf43482b610427b","created_at":"2026-07-28T08:19:04.604Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9147f379ff4f4181a36ebbc9d3c1a8a3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.636Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b0f00a191cf43482b610427b: done: 0.045335 sec","job_status":"done","queue_duration_s":1.190377,"scheduling_latency_s":1.190421,"redis_calls":12,"redis_duration_s":0.005836,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000891,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002632,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002313,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00730082,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.045335,"completed_at":"2026-07-28T08:19:05.872Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004243,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1672gitlab # [ 385.227931] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6a0230e19d0d3c7ff1957dc9","created_at":"2026-07-28T08:19:04.644Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd514eb26f3ffe6b2133ff67d4fe963e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-28T08:19:04.667Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6a0230e19d0d3c7ff1957dc9: start","job_status":"start","queue_duration_s":1.208028,"scheduling_latency_s":1.208069}1673gitlab # [ 385.242740] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.897Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1674gitlab # [ 385.247073] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"6a0230e19d0d3c7ff1957dc9","created_at":"2026-07-28T08:19:04.644Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd514eb26f3ffe6b2133ff67d4fe963e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-28T08:19:04.667Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-6a0230e19d0d3c7ff1957dc9: done: 0.032283 sec","job_status":"done","queue_duration_s":1.208028,"scheduling_latency_s":1.208069,"redis_calls":9,"redis_duration_s":0.003539,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000947,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001877,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032283,"completed_at":"2026-07-28T08:19:05.907Z","load_balancing_strategy":"primary","db_duration_s":0.00146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1675gitlab # [ 385.294038] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.910Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 0c133b5452446e9af6444606680b063f86b87237 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"737f2029e1ffa2fe6459b0fd","created_at":"2026-07-28T08:19:04.642Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-8370bedb6c884e4c","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.687Z","job_size_bytes":185,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-737f2029e1ffa2fe6459b0fd: start","job_status":"start","queue_duration_s":1.222932,"scheduling_latency_s":1.222971}1676gitlab # [ 385.312483] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:05.941Z","message":"changes: \"0000000000000000000000000000000000000000 0c133b5452446e9af6444606680b063f86b87237 refs/heads/master\\n\""}1677gitlab # [ 385.315584] gitaly[1368]: time="2026-07-28T08:19:06.011Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:15.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:06.000" grpc.time_ms=11.269 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678gitlab # [ 385.331224] gitaly[1368]: time="2026-07-28T08:19:06.040Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-28T08:19:16.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:06.020" grpc.time_ms=18.957 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679gitlab # [ 385.346197] gitaly[1368]: time="2026-07-28T08:19:06.128Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=7 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-28T08:19:16.100" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:06.110" grpc.time_ms=17.478 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680gitlab # [ 385.361911] gitaly[1368]: time="2026-07-28T08:19:06.183Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:06.183" grpc.time_ms=0.527 pid=1368 span.kind=server system=grpc1681gitlab # [ 385.372479] gitaly[1368]: time="2026-07-28T08:19:06.214Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:06.214" grpc.time_ms=0.554 pid=1368 span.kind=server system=grpc1682gitlab # [ 385.382790] gitaly[1368]: time="2026-07-28T08:19:06.227Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY diskcache=fa637edf-bf05-4c81-aa71-fa3d10f5b8be grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-28T08:19:16.138" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:06.149" pid=1368 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1683gitlab # [ 385.393766] gitaly[1368]: time="2026-07-28T08:19:06.228Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=70 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5028 command.oublock=8 command.real_time_ms=67 command.spawn_token_fork_ms=1 command.system_time_ms=26 command.user_time_ms=44 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-28T08:19:16.138" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:06.149" grpc.time_ms=78.865 pid=1368 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1684gitlab # [ 385.408543] gitaly[1368]: time="2026-07-28T08:19:06.246Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-28T08:19:16.235" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:06.246" grpc.time_ms=0.207 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685gitlab # [ 385.420137] gitaly[1368]: time="2026-07-28T08:19:06.267Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=863 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-28T08:19:16.242" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:06.253" grpc.time_ms=14.511 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1686gitlab # [ 385.435652] nixbot[4283]: {"ts": "2026-07-28T08:19:06.312Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1687gitlab # [ 385.468420] nixbot[4283]: {"ts": "2026-07-28T08:19:06.345Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1688gitlab # [ 385.489413] nixbot[4283]: {"ts": "2026-07-28T08:19:06.366Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1689gitlab # [ 385.498272] nixbot[4283]: {"ts": "2026-07-28T08:19:06.375Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1690gitlab # [ 385.508652] nixbot[4283]: {"ts": "2026-07-28T08:19:06.386Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1691gitlab # [ 385.520924] nixbot[4283]: {"ts": "2026-07-28T08:19:06.398Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1692gitlab # [ 385.529496] nixbot[4283]: {"ts": "2026-07-28T08:19:06.406Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1693gitlab # [ 385.533237] gitaly[1368]: time="2026-07-28T08:19:06.407Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-07-28T08:19:36.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:06.399" grpc.time_ms=7.967 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1694gitlab # [ 385.555177] nixbot[4283]: {"ts": "2026-07-28T08:19:06.412Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1695gitlab # [ 385.558185] nixbot[4283]: {"ts": "2026-07-28T08:19:06.423Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1696gitlab # [ 385.561236] nixbot[4283]: {"ts": "2026-07-28T08:19:06.427Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1697gitlab # [ 385.564116] nixbot[4283]: {"ts": "2026-07-28T08:19:06.435Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1698gitlab # [ 385.568205] nixbot[4283]: {"ts": "2026-07-28T08:19:06.445Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1699gitlab # [ 385.578115] nixbot[4283]: {"ts": "2026-07-28T08:19:06.455Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1700gitlab # [ 385.584706] nixbot[4283]: {"ts": "2026-07-28T08:19:06.462Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1701gitlab # [ 385.590332] gitaly[1368]: time="2026-07-28T08:19:06.468Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-28T08:19:16.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:06.467" grpc.time_ms=0.525 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1702gitlab # [ 385.602216] nixbot[4283]: {"ts": "2026-07-28T08:19:06.471Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1703gitlab # [ 385.604553] nixbot[4283]: {"ts": "2026-07-28T08:19:06.474Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1704gitlab # [ 385.606736] nixbot[4283]: {"ts": "2026-07-28T08:19:06.477Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1705gitlab # [ 385.609253] nixbot[4283]: {"ts": "2026-07-28T08:19:06.480Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1706gitlab # [ 385.611627] gitaly[1368]: time="2026-07-28T08:19:06.487Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-28T08:19:16.016" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-07-28T08:19:06.476" grpc.time_ms=10.74 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707gitlab # [ 385.625617] nixbot[4283]: {"ts": "2026-07-28T08:19:06.489Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1708gitlab # [ 385.627858] nixbot[4283]: {"ts": "2026-07-28T08:19:06.492Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1709gitlab # [ 385.630317] nixbot[4283]: {"ts": "2026-07-28T08:19:06.495Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1710gitlab # [ 385.632519] nixbot[4283]: {"ts": "2026-07-28T08:19:06.503Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1711gitlab # [ 385.634736] nixbot[4283]: {"ts": "2026-07-28T08:19:06.505Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1712gitlab # [ 385.636972] nixbot[4283]: {"ts": "2026-07-28T08:19:06.508Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1713gitlab # [ 385.676389] gitaly[1368]: time="2026-07-28T08:19:06.554Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:16.066" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:06.527" grpc.time_ms=26.773 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1714gitlab # [ 385.699396] gitaly[1368]: time="2026-07-28T08:19:06.577Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:16.103" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:06.563" grpc.time_ms=13.166 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1715gitlab # [ 385.749268] gitaly[1368]: time="2026-07-28T08:19:06.626Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-28T08:19:36.304" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:06.605" grpc.time_ms=21.653 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1716gitlab # [ 386.127928] nixbot[4283]: INFO: Started server process [4283]1717gitlab # [ 386.131736] nixbot[4283]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1718gitlab # [ 386.137323] nixbot[4283]: INFO: ::ffff:127.0.0.1:33126 - "GET /health HTTP/1.1" 200 OK1719gitlab # [ 386.152697] systemd[1]: Started nixbot CI service.1720gitlab # [ 386.154067] systemd[1]: Reached target Multi-User System.1721gitlab # [ 386.155209] systemd[1]: Startup finished in 775ms (kernel) + 6.231s (initrd) + 6min 19.147s (userspace) = 6min 26.155s.1722gitlab # [ 386.284645] gitaly[1368]: time="2026-07-28T08:19:07.162Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-28T08:19:17.149" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:07.160" grpc.time_ms=2.187 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1723gitlab # [ 386.350773] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.227Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 0c133b5452446e9af6444606680b063f86b87237 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"737f2029e1ffa2fe6459b0fd","created_at":"2026-07-28T08:19:04.642Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-8370bedb6c884e4c","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.687Z","job_size_bytes":185,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-737f2029e1ffa2fe6459b0fd: done: 1.316526 sec","job_status":"done","queue_duration_s":1.222932,"scheduling_latency_s":1.222971,"gitaly_calls":13,"gitaly_duration_s":0.297824,"redis_calls":199,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.084544,"redis_read_bytes":961,"redis_write_bytes":19726,"redis_cache_calls":14,"redis_cache_duration_s":0.00594,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":32,"redis_feature_flag_duration_s":0.016512,"redis_feature_flag_read_bytes":540,"redis_feature_flag_write_bytes":4279,"redis_queues_calls":8,"redis_queues_duration_s":0.004652,"redis_queues_read_bytes":12,"redis_queues_write_bytes":4932,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.007882,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.027527,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.022031,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":51,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":51,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.1,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":51,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.356,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.399,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.1,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.857612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00141582,"exclusive_lock_hold_duration_s":0.05327664,"duration_s":1.316526,"completed_at":"2026-07-28T08:19:07.226Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.152553,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1724gitlab # [ 386.419173] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.230Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7df7f6492594e3843ae63c55","created_at":"2026-07-28T08:19:04.675Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a35b2b60b8722e46dac836c13bdd3b7","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.693Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7df7f6492594e3843ae63c55: start","job_status":"start","queue_duration_s":2.536161,"scheduling_latency_s":2.536199}1725gitlab # [ 386.434457] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7df7f6492594e3843ae63c55","created_at":"2026-07-28T08:19:04.675Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a35b2b60b8722e46dac836c13bdd3b7","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.693Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7df7f6492594e3843ae63c55: done: 0.03501 sec","job_status":"done","queue_duration_s":2.536161,"scheduling_latency_s":2.536199,"redis_calls":11,"redis_duration_s":0.004468,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000842,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00118346,"exclusive_lock_hold_duration_s":0.00376668,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.03501,"completed_at":"2026-07-28T08:19:07.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1726gitlab # [ 386.479423] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fd2a2538ceb995364c90deaa","created_at":"2026-07-28T08:19:04.702Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee7aa029640c19470de28b3ce94d02bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.723Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fd2a2538ceb995364c90deaa: start","job_status":"start","queue_duration_s":2.543383,"scheduling_latency_s":2.543416}1727gitlab # [ 386.494938] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fd2a2538ceb995364c90deaa","created_at":"2026-07-28T08:19:04.702Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee7aa029640c19470de28b3ce94d02bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.723Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fd2a2538ceb995364c90deaa: done: 0.029183 sec","job_status":"done","queue_duration_s":2.543383,"scheduling_latency_s":2.543416,"redis_calls":9,"redis_duration_s":0.003935,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001358,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000695,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029183,"completed_at":"2026-07-28T08:19:07.296Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1728gitlab # [ 386.540533] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1daf0628e96f38d74dd74cb1","created_at":"2026-07-28T08:19:04.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdfcac2cfb93e65fad3b31636a1e294b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.774Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1daf0628e96f38d74dd74cb1: start","job_status":"start","queue_duration_s":2.52453,"scheduling_latency_s":2.524568}1729gitlab: (finished: waiting for unit nixbot.service, in 2.23 seconds)1730gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1731gitlab # [ 386.869182] nixbot[4283]: INFO: ::ffff:127.0.0.1:33132 - "GET /health HTTP/1.1" 200 OK1732gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1733subtest: project discovered and webhook registered1734gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1735gitlab # [ 386.950595] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1daf0628e96f38d74dd74cb1","created_at":"2026-07-28T08:19:04.737Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdfcac2cfb93e65fad3b31636a1e294b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.774Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1daf0628e96f38d74dd74cb1: done: 0.528372 sec","job_status":"done","queue_duration_s":2.52453,"scheduling_latency_s":2.524568,"redis_calls":13,"redis_duration_s":0.0058130000000000005,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001396,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002187,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.074,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.436111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00098544,"exclusive_lock_hold_duration_s":0.48770766,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.528372,"completed_at":"2026-07-28T08:19:07.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.115631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1737gitlab # [ 387.024873] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5093ec2d12a92a630e329187","created_at":"2026-07-28T08:19:04.782Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db7f9a3ac9294d4fc009b0b9f147cc57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-28T08:19:04.827Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5093ec2d12a92a630e329187: start","job_status":"start","queue_duration_s":3.008797,"scheduling_latency_s":3.008846}1738gitlab # [ 387.039868] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.868Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1739gitlab # [ 387.043807] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.883Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5093ec2d12a92a630e329187","created_at":"2026-07-28T08:19:04.782Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db7f9a3ac9294d4fc009b0b9f147cc57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-28T08:19:04.827Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5093ec2d12a92a630e329187: done: 0.047102 sec","job_status":"done","queue_duration_s":3.008797,"scheduling_latency_s":3.008846,"redis_calls":9,"redis_duration_s":0.007763,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002755,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003984,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047102,"completed_at":"2026-07-28T08:19:07.882Z","load_balancing_strategy":"primary","db_duration_s":0.003773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1740gitlab # [ 387.089593] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8b280f44d89009623c0a0e81","created_at":"2026-07-28T08:19:04.851Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f57643d14c979d1a654399d4197de9ef","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.874Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8b280f44d89009623c0a0e81: start","job_status":"start","queue_duration_s":3.013193,"scheduling_latency_s":3.013242}1741gitlab # [ 387.104297] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.935Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8b280f44d89009623c0a0e81","created_at":"2026-07-28T08:19:04.851Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f57643d14c979d1a654399d4197de9ef","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.874Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8b280f44d89009623c0a0e81: done: 0.048223 sec","job_status":"done","queue_duration_s":3.013193,"scheduling_latency_s":3.013242,"redis_calls":9,"redis_duration_s":0.011509,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002457,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048223,"completed_at":"2026-07-28T08:19:07.935Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1742gitlab # [ 387.149094] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"377a8b7c4d1261ef6dfd4e20","created_at":"2026-07-28T08:19:04.885Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddb38a6c340e050d8804ffcfea019783","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.908Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-377a8b7c4d1261ef6dfd4e20: start","job_status":"start","queue_duration_s":3.030144,"scheduling_latency_s":3.030185}1743gitlab # [ 387.163272] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"377a8b7c4d1261ef6dfd4e20","created_at":"2026-07-28T08:19:04.885Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddb38a6c340e050d8804ffcfea019783","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:04.908Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-377a8b7c4d1261ef6dfd4e20: done: 0.040144 sec","job_status":"done","queue_duration_s":3.030144,"scheduling_latency_s":3.030185,"redis_calls":11,"redis_duration_s":0.003712,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000646,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00145,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00102606,"exclusive_lock_hold_duration_s":0.00441234,"duration_s":0.040144,"completed_at":"2026-07-28T08:19:07.978Z","load_balancing_strategy":"primary","db_duration_s":0.002513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1744gitlab # [ 387.206961] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:07.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fc1d9993cf0b6a1e1fb06b54","created_at":"2026-07-28T08:19:04.913Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b243ba3db02068e14e20a6cf4a31f5f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-28T08:19:04.945Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fc1d9993cf0b6a1e1fb06b54: start","job_status":"start","queue_duration_s":3.03553,"scheduling_latency_s":3.035566}1745gitlab # [ 387.221369] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.20.0" 1081746gitlab # [ 387.223711] gitaly[1368]: time="2026-07-28T08:19:07.919Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWQ47T8YR1D0YF689FX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-28T08:19:37.098" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:07.898" grpc.time_ms=21.054 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 387.240176] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fc1d9993cf0b6a1e1fb06b54","created_at":"2026-07-28T08:19:04.913Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b243ba3db02068e14e20a6cf4a31f5f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-28T08:19:04.945Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fc1d9993cf0b6a1e1fb06b54: done: 0.038125 sec","job_status":"done","queue_duration_s":3.03553,"scheduling_latency_s":3.035566,"redis_calls":9,"redis_duration_s":0.00341,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000741,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001895,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038125,"completed_at":"2026-07-28T08:19:08.018Z","load_balancing_strategy":"primary","db_duration_s":0.00191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1748gitlab # [ 387.282618] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.021Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"be58fbde3bf40b3c86892fdd","created_at":"2026-07-28T08:19:04.973Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8cb1553eb25594f409c363b09475e42","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.004Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-be58fbde3bf40b3c86892fdd: start","job_status":"start","queue_duration_s":3.016784,"scheduling_latency_s":3.016817}1749gitlab # [ 387.297969] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.078Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"be58fbde3bf40b3c86892fdd","created_at":"2026-07-28T08:19:04.973Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8cb1553eb25594f409c363b09475e42","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.004Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-be58fbde3bf40b3c86892fdd: done: 0.057148 sec","job_status":"done","queue_duration_s":3.016784,"scheduling_latency_s":3.016817,"redis_calls":15,"redis_duration_s":0.006026,"redis_read_bytes":13,"redis_write_bytes":1859,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00354,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057148,"completed_at":"2026-07-28T08:19:08.078Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1750gitlab # [ 387.342788] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.080Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ecd75b2beba378d103210440","created_at":"2026-07-28T08:19:05.016Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7b57541a53d45c0c3478a156b2405e9","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.050Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ecd75b2beba378d103210440: start","job_status":"start","queue_duration_s":3.03037,"scheduling_latency_s":3.03041}1751gitlab # [ 387.510495] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:08 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 13721752gitlab # [ 387.514615] nixbot[4283]: {"ts": "2026-07-28T08:19:08.389Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1753gitlab # [ 387.533147] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.408Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ecd75b2beba378d103210440","created_at":"2026-07-28T08:19:05.016Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7b57541a53d45c0c3478a156b2405e9","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.050Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ecd75b2beba378d103210440: done: 0.328447 sec","job_status":"done","queue_duration_s":3.03037,"scheduling_latency_s":3.03041,"redis_calls":573,"redis_duration_s":0.078476,"redis_read_bytes":571,"redis_write_bytes":49790,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000772,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002256,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.075448,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.290659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.328447,"completed_at":"2026-07-28T08:19:08.408Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000995,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1754gitlab # [ 387.621771] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9ac43c3b9b3b6ceee03b8167","created_at":"2026-07-28T08:19:05.077Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7108400ddf1f8cd0529f2a424f1c40b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.106Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9ac43c3b9b3b6ceee03b8167: start","job_status":"start","queue_duration_s":3.305001,"scheduling_latency_s":3.30504}1755gitlab # [ 387.640806] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.439Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1756gitlab # [ 387.644911] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9ac43c3b9b3b6ceee03b8167","created_at":"2026-07-28T08:19:05.077Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7108400ddf1f8cd0529f2a424f1c40b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.106Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9ac43c3b9b3b6ceee03b8167: done: 0.039267 sec","job_status":"done","queue_duration_s":3.305001,"scheduling_latency_s":3.30504,"redis_calls":9,"redis_duration_s":0.003724,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00073,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039267,"completed_at":"2026-07-28T08:19:08.450Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004416,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1757gitlab # [ 387.695170] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"48ff7a90024d8b161aa56ac9","created_at":"2026-07-28T08:19:05.128Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93274fcf7b081720ee92856728ac2e3c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.159Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-48ff7a90024d8b161aa56ac9: start","job_status":"start","queue_duration_s":3.293889,"scheduling_latency_s":3.293934}1758gitlab # [ 387.709909] nixbot[4283]: {"ts": "2026-07-28T08:19:08.420Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1759gitlab # [ 387.712276] nixbot[4283]: {"ts": "2026-07-28T08:19:08.513Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1760gitlab # [ 387.714611] nixbot[4283]: {"ts": "2026-07-28T08:19:08.515Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1761gitlab # [ 387.716715] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 831762gitlab # [ 387.718861] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"48ff7a90024d8b161aa56ac9","created_at":"2026-07-28T08:19:05.128Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93274fcf7b081720ee92856728ac2e3c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.159Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-48ff7a90024d8b161aa56ac9: done: 0.083544 sec","job_status":"done","queue_duration_s":3.293889,"scheduling_latency_s":3.293934,"redis_calls":20,"redis_duration_s":0.014767,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.007479,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000833,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005142,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001313,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050058,"duration_s":0.083544,"completed_at":"2026-07-28T08:19:08.536Z","load_balancing_strategy":"primary","db_duration_s":0.003113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1763gitlab # [ 387.764154] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e7740f0973689d7efe4c1e76","created_at":"2026-07-28T08:19:05.191Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6678b54d8250e61c72c00f1779c91fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.217Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e7740f0973689d7efe4c1e76: start","job_status":"start","queue_duration_s":3.322202,"scheduling_latency_s":3.322245}1764gitlab # [ 387.780346] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e7740f0973689d7efe4c1e76","created_at":"2026-07-28T08:19:05.191Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6678b54d8250e61c72c00f1779c91fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.217Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e7740f0973689d7efe4c1e76: done: 0.069429 sec","job_status":"done","queue_duration_s":3.322202,"scheduling_latency_s":3.322245,"redis_calls":11,"redis_duration_s":0.005613,"redis_read_bytes":9,"redis_write_bytes":1509,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000655,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002768,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00112906,"exclusive_lock_hold_duration_s":0.03245746,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.069429,"completed_at":"2026-07-28T08:19:08.608Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765gitlab # [ 387.827289] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"577ec2c56c0d32671f3f1cda","created_at":"2026-07-28T08:19:05.243Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72473f604e1d2efa1347d1febe086a49","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.273Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-577ec2c56c0d32671f3f1cda: start","job_status":"start","queue_duration_s":3.33773,"scheduling_latency_s":3.33777}1766gitlab # [ 387.844185] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.634Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1767gitlab # [ 387.847638] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"577ec2c56c0d32671f3f1cda","created_at":"2026-07-28T08:19:05.243Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-3d2e0949055d4d7c","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72473f604e1d2efa1347d1febe086a49","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.273Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-577ec2c56c0d32671f3f1cda: done: 0.032415 sec","job_status":"done","queue_duration_s":3.33773,"scheduling_latency_s":3.33777,"redis_calls":9,"redis_duration_s":0.002899,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000626,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032415,"completed_at":"2026-07-28T08:19:08.643Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1768gitlab # [ 387.892546] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8be4b27f3fa3dfff47712175","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8be4b27f3fa3dfff47712175: start","job_status":"start","queue_duration_s":3.219513,"scheduling_latency_s":3.219554}1769gitlab # [ 387.905608] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8be4b27f3fa3dfff47712175","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8be4b27f3fa3dfff47712175: done: 0.054134 sec","job_status":"done","queue_duration_s":3.219513,"scheduling_latency_s":3.219554,"redis_calls":23,"redis_duration_s":0.008815,"redis_read_bytes":20,"redis_write_bytes":2604,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.004118,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1447,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002162,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002535,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.054134,"completed_at":"2026-07-28T08:19:08.700Z","load_balancing_strategy":"primary","db_duration_s":0.004413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1770gitlab # [ 387.948971] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c048c48f775c872a84054a92","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c048c48f775c872a84054a92: start","job_status":"start","queue_duration_s":3.276246,"scheduling_latency_s":3.276286}1771gitlab # [ 387.962055] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c048c48f775c872a84054a92","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c048c48f775c872a84054a92: done: 0.026669 sec","job_status":"done","queue_duration_s":3.276246,"scheduling_latency_s":3.276286,"redis_calls":13,"redis_duration_s":0.004712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002303,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002409,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026669,"completed_at":"2026-07-28T08:19:08.729Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1772gitlab # [ 388.003338] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e852a00e8cbb35f77909fcd5","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e852a00e8cbb35f77909fcd5: start","job_status":"start","queue_duration_s":3.30731,"scheduling_latency_s":3.307346}1773gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1774gitlab # [ 388.016452] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e852a00e8cbb35f77909fcd5","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e852a00e8cbb35f77909fcd5: done: 0.026643 sec","job_status":"done","queue_duration_s":3.30731,"scheduling_latency_s":3.307346,"redis_calls":13,"redis_duration_s":0.00453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001408,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026643,"completed_at":"2026-07-28T08:19:08.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1775gitlab # [ 388.056396] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"652d3a44b8a9476037e4c2af","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-652d3a44b8a9476037e4c2af: start","job_status":"start","queue_duration_s":3.336222,"scheduling_latency_s":3.336261}1776gitlab # [ 388.069092] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 3171777gitlab # [ 388.071706] nixbot[4283]: {"ts": "2026-07-28T08:19:08.837Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1778gitlab # [ 388.079106] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"652d3a44b8a9476037e4c2af","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-652d3a44b8a9476037e4c2af: done: 0.025979 sec","job_status":"done","queue_duration_s":3.336222,"scheduling_latency_s":3.336261,"redis_calls":13,"redis_duration_s":0.004088,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001408,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00268,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025979,"completed_at":"2026-07-28T08:19:08.788Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1779gitlab # [ 388.121379] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab4f7815693ece0b362279e0","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab4f7815693ece0b362279e0: start","job_status":"start","queue_duration_s":3.364562,"scheduling_latency_s":3.364601}1780gitlab # [ 388.134779] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab4f7815693ece0b362279e0","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab4f7815693ece0b362279e0: done: 0.025364 sec","job_status":"done","queue_duration_s":3.364562,"scheduling_latency_s":3.364601,"redis_calls":13,"redis_duration_s":0.004189,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025364,"completed_at":"2026-07-28T08:19:08.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1781gitlab # [ 388.176372] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d26d1ab51797231d32b26f99","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d26d1ab51797231d32b26f99: start","job_status":"start","queue_duration_s":3.392448,"scheduling_latency_s":3.392485}1782gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds)1783(finished: subtest: project discovered and webhook registered, in 1.35 seconds)1784subtest: push delivers the webhook1785gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1786gitlab # [ 388.189318] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d26d1ab51797231d32b26f99","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d26d1ab51797231d32b26f99: done: 0.03134 sec","job_status":"done","queue_duration_s":3.392448,"scheduling_latency_s":3.392485,"redis_calls":13,"redis_duration_s":0.00942,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03134,"completed_at":"2026-07-28T08:19:08.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1787gitlab # [ 388.230888] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef4172d5030ab9664cfbfe5c","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef4172d5030ab9664cfbfe5c: start","job_status":"start","queue_duration_s":3.426422,"scheduling_latency_s":3.426458}1788gitlab # [ 388.244266] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef4172d5030ab9664cfbfe5c","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef4172d5030ab9664cfbfe5c: done: 0.029283 sec","job_status":"done","queue_duration_s":3.426422,"scheduling_latency_s":3.426458,"redis_calls":13,"redis_duration_s":0.005589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029283,"completed_at":"2026-07-28T08:19:08.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1789gitlab # [ 388.286604] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ade945c2d8fdd1a66e92d68","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ade945c2d8fdd1a66e92d68: start","job_status":"start","queue_duration_s":3.457817,"scheduling_latency_s":3.457854}1790gitlab # [ 388.299969] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ade945c2d8fdd1a66e92d68","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ade945c2d8fdd1a66e92d68: done: 0.026637 sec","job_status":"done","queue_duration_s":3.457817,"scheduling_latency_s":3.457854,"redis_calls":13,"redis_duration_s":0.002843,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026637,"completed_at":"2026-07-28T08:19:08.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1791gitlab # [ 388.340556] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70edc300482583fd0544b90b","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70edc300482583fd0544b90b: start","job_status":"start","queue_duration_s":3.4865,"scheduling_latency_s":3.486536}1792gitlab # [ 388.353322] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70edc300482583fd0544b90b","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70edc300482583fd0544b90b: done: 0.025674 sec","job_status":"done","queue_duration_s":3.4865,"scheduling_latency_s":3.486536,"redis_calls":13,"redis_duration_s":0.003469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002272,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025674,"completed_at":"2026-07-28T08:19:08.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1793gitlab # [ 388.393182] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e082dea00446947de9637175","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e082dea00446947de9637175: start","job_status":"start","queue_duration_s":3.515822,"scheduling_latency_s":3.515863}1794gitlab # [ 388.406510] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 1061795gitlab # [ 388.408591] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:09 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 3121796gitlab # [ 388.410945] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 711797gitlab # [ 388.413222] nixbot[4283]: {"ts": "2026-07-28T08:19:09.163Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1798gitlab # [ 388.415752] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e082dea00446947de9637175","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e082dea00446947de9637175: done: 0.029846 sec","job_status":"done","queue_duration_s":3.515822,"scheduling_latency_s":3.515863,"redis_calls":13,"redis_duration_s":0.0035779999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029846,"completed_at":"2026-07-28T08:19:08.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1799gitlab # [ 388.458111] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80aa46f1a4921ddce222b453","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80aa46f1a4921ddce222b453: start","job_status":"start","queue_duration_s":3.547589,"scheduling_latency_s":3.547624}1800gitlab # [ 388.470943] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80aa46f1a4921ddce222b453","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80aa46f1a4921ddce222b453: done: 0.019569 sec","job_status":"done","queue_duration_s":3.547589,"scheduling_latency_s":3.547624,"redis_calls":13,"redis_duration_s":0.00234,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001687,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019569,"completed_at":"2026-07-28T08:19:08.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1801gitlab # [ 388.511973] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:08.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a642ce0547063424ebbdcbd","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a642ce0547063424ebbdcbd: start","job_status":"start","queue_duration_s":3.568854,"scheduling_latency_s":3.568886}1802gitlab # [ 388.524829] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a642ce0547063424ebbdcbd","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a642ce0547063424ebbdcbd: done: 0.023447 sec","job_status":"done","queue_duration_s":3.568854,"scheduling_latency_s":3.568886,"redis_calls":13,"redis_duration_s":0.00255,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001641,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023447,"completed_at":"2026-07-28T08:19:09.018Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1803gitlab # [ 388.565396] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c3cf1a81223326d6a2f276","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c3cf1a81223326d6a2f276: start","job_status":"start","queue_duration_s":3.594265,"scheduling_latency_s":3.594299}1804gitlab # Enumerating objects: 5, done.1805gitlab # [ 388.578169] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c3cf1a81223326d6a2f276","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c3cf1a81223326d6a2f276: done: 0.022066 sec","job_status":"done","queue_duration_s":3.594265,"scheduling_latency_s":3.594299,"redis_calls":13,"redis_duration_s":0.002398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001458,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022066,"completed_at":"2026-07-28T08:19:09.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1806gitlab # [ 388.619143] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3d7be865b9e0fe6d0b51a59","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3d7be865b9e0fe6d0b51a59: start","job_status":"start","queue_duration_s":3.618104,"scheduling_latency_s":3.618138}1807gitlab # Counting objects: 20% (1/5)[ 388.632147] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3d7be865b9e0fe6d0b51a59","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3d7be865b9e0fe6d0b51a59: done: 0.021525 sec","job_status":"done","queue_duration_s":3.618104,"scheduling_latency_s":3.618138,"redis_calls":13,"redis_duration_s":0.002367,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001459,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021525,"completed_at":"2026-07-28T08:19:09.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1808gitlab # Counting objects: 40% (2/5)[ 388.673057] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9044b2f4713ab77f74307b48","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9044b2f4713ab77f74307b48: start","job_status":"start","queue_duration_s":3.641635,"scheduling_latency_s":3.64167}1809gitlab # Counting objects: 60% (3/5)[ 388.687762] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9044b2f4713ab77f74307b48","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9044b2f4713ab77f74307b48: done: 0.021422 sec","job_status":"done","queue_duration_s":3.641635,"scheduling_latency_s":3.64167,"redis_calls":13,"redis_duration_s":0.002383,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001469,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021422,"completed_at":"2026-07-28T08:19:09.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1810gitlab # Counting objects: 80% (4/5)[ 388.728346] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bc9fb8410ba33705b9523de","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bc9fb8410ba33705b9523de: start","job_status":"start","queue_duration_s":3.665103,"scheduling_latency_s":3.665136}1811gitlab # Counting objects: 100% (5/5)[ 388.741383] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bc9fb8410ba33705b9523de","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bc9fb8410ba33705b9523de: done: 0.038995 sec","job_status":"done","queue_duration_s":3.665103,"scheduling_latency_s":3.665136,"redis_calls":13,"redis_duration_s":0.011762,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007776,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038995,"completed_at":"2026-07-28T08:19:09.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1812gitlab # Counting objects: 100% (5/5), done.1813gitlab # [ 388.781993] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45b875ae40ddc1a0b5bd89f7","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45b875ae40ddc1a0b5bd89f7: start","job_status":"start","queue_duration_s":3.712392,"scheduling_latency_s":3.712438}1814gitlab # [ 388.795304] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45b875ae40ddc1a0b5bd89f7","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45b875ae40ddc1a0b5bd89f7: done: 0.033915 sec","job_status":"done","queue_duration_s":3.712392,"scheduling_latency_s":3.712438,"redis_calls":13,"redis_duration_s":0.008215,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004392,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033915,"completed_at":"2026-07-28T08:19:09.172Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1815gitlab # Delta compression using up to 4 threads[ 388.835965] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1f363fa749657cbb8aef689","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1f363fa749657cbb8aef689: start","job_status":"start","queue_duration_s":3.74944,"scheduling_latency_s":3.749484}1816gitlab # 1817gitlab # [ 388.849474] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1f363fa749657cbb8aef689","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1f363fa749657cbb8aef689: done: 0.027518 sec","job_status":"done","queue_duration_s":3.74944,"scheduling_latency_s":3.749484,"redis_calls":13,"redis_duration_s":0.0068070000000000006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005296,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027518,"completed_at":"2026-07-28T08:19:09.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1818gitlab # Compressing objects: 50% (1/2)[ 388.889803] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64c5029f7ccd507c23691d19","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64c5029f7ccd507c23691d19: start","job_status":"start","queue_duration_s":3.785643,"scheduling_latency_s":3.78568}1819gitlab # Compressing objects: 100% (2/2)[ 388.904811] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64c5029f7ccd507c23691d19","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64c5029f7ccd507c23691d19: done: 0.039438 sec","job_status":"done","queue_duration_s":3.785643,"scheduling_latency_s":3.78568,"redis_calls":13,"redis_duration_s":0.01304,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005336,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039438,"completed_at":"2026-07-28T08:19:09.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1820gitlab # Compressing objects: 100% (2/2), done.1821gitlab # [ 388.945655] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41e1811267ea8771550349c2","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41e1811267ea8771550349c2: start","job_status":"start","queue_duration_s":3.832616,"scheduling_latency_s":3.832662}1822gitlab # Writing objects: 33% (1/3)[ 388.960585] gitaly[1368]: time="2026-07-28T08:19:09.427Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSA2NW47XHBD7Y0HMZ5Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:09.412" grpc.time_ms=14.891 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1823gitlab # Writing objects: 66% (2/3)[ 388.974993] nixbot[4283]: {"ts": "2026-07-28T08:19:09.474Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1824gitlab # Writing objects: 100% (3/3)[ 388.978071] nixbot[4283]: {"ts": "2026-07-28T08:19:09.579Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1825gitlab # Writing objects: 100% (3/3), 272 bytes | 8.00 KiB/s, done.1826gitlab # [ 388.981153] nixbot[4283]: {"ts": "2026-07-28T08:19:09.794Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1827gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)[ 388.985271] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41e1811267ea8771550349c2","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41e1811267ea8771550349c2: done: 0.04475 sec","job_status":"done","queue_duration_s":3.832616,"scheduling_latency_s":3.832662,"redis_calls":13,"redis_duration_s":0.015487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005273,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010214,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04475,"completed_at":"2026-07-28T08:19:09.303Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1828gitlab # 1829gitlab # [ 389.026907] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"057d20431a60fc254e5dad10","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-057d20431a60fc254e5dad10: start","job_status":"start","queue_duration_s":3.88221,"scheduling_latency_s":3.88225}1830gitlab # [ 389.039888] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"057d20431a60fc254e5dad10","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-057d20431a60fc254e5dad10: done: 0.049652 sec","job_status":"done","queue_duration_s":3.88221,"scheduling_latency_s":3.88225,"redis_calls":13,"redis_duration_s":0.013456000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003719,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049652,"completed_at":"2026-07-28T08:19:09.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1831gitlab # [ 389.081643] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d14ca3e08ac3110d2f436c80","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d14ca3e08ac3110d2f436c80: start","job_status":"start","queue_duration_s":3.937296,"scheduling_latency_s":3.937343}1832gitlab # [ 389.094810] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d14ca3e08ac3110d2f436c80","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d14ca3e08ac3110d2f436c80: done: 0.046114 sec","job_status":"done","queue_duration_s":3.937296,"scheduling_latency_s":3.937343,"redis_calls":13,"redis_duration_s":0.013758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00357,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046114,"completed_at":"2026-07-28T08:19:09.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1833gitlab # [ 389.139653] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95c0524dcd825fc370b236cb","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95c0524dcd825fc370b236cb: start","job_status":"start","queue_duration_s":3.989552,"scheduling_latency_s":3.989598}1834gitlab # [ 389.152782] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95c0524dcd825fc370b236cb","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95c0524dcd825fc370b236cb: done: 0.038092 sec","job_status":"done","queue_duration_s":3.989552,"scheduling_latency_s":3.989598,"redis_calls":13,"redis_duration_s":0.004086,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038092,"completed_at":"2026-07-28T08:19:09.454Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1835gitlab # [ 389.193186] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"662ff5dba36920051b98af67","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-662ff5dba36920051b98af67: start","job_status":"start","queue_duration_s":4.029699,"scheduling_latency_s":4.029736}1836gitlab # [ 389.206003] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"662ff5dba36920051b98af67","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-662ff5dba36920051b98af67: done: 0.028039 sec","job_status":"done","queue_duration_s":4.029699,"scheduling_latency_s":4.029736,"redis_calls":13,"redis_duration_s":0.005047,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028039,"completed_at":"2026-07-28T08:19:09.484Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1837gitlab # [ 389.246897] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20169ccec4f711bd437def1d","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20169ccec4f711bd437def1d: start","job_status":"start","queue_duration_s":4.05981,"scheduling_latency_s":4.059848}1838gitlab # [ 389.260595] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20169ccec4f711bd437def1d","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20169ccec4f711bd437def1d: done: 0.025851 sec","job_status":"done","queue_duration_s":4.05981,"scheduling_latency_s":4.059848,"redis_calls":13,"redis_duration_s":0.003198,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025851,"completed_at":"2026-07-28T08:19:09.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1839gitlab # [ 389.303328] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d58293b075ee6ba692ca8de0","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d58293b075ee6ba692ca8de0: start","job_status":"start","queue_duration_s":4.087757,"scheduling_latency_s":4.087796}1840gitlab # [ 389.316807] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d58293b075ee6ba692ca8de0","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d58293b075ee6ba692ca8de0: done: 0.024446 sec","job_status":"done","queue_duration_s":4.087757,"scheduling_latency_s":4.087796,"redis_calls":13,"redis_duration_s":0.0026820000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001667,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024446,"completed_at":"2026-07-28T08:19:09.538Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1841gitlab # [ 389.358159] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f9cdf8e83a5e9f8fde83c7f","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f9cdf8e83a5e9f8fde83c7f: start","job_status":"start","queue_duration_s":4.11405,"scheduling_latency_s":4.114086}1842gitlab # [ 389.375142] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f9cdf8e83a5e9f8fde83c7f","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f9cdf8e83a5e9f8fde83c7f: done: 0.024681 sec","job_status":"done","queue_duration_s":4.11405,"scheduling_latency_s":4.114086,"redis_calls":13,"redis_duration_s":0.002682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001609,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024681,"completed_at":"2026-07-28T08:19:09.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1843gitlab # [ 389.425495] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1566d4900382e98d032f3597","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1566d4900382e98d032f3597: start","job_status":"start","queue_duration_s":4.141217,"scheduling_latency_s":4.141257}1844gitlab # [ 389.439856] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1566d4900382e98d032f3597","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1566d4900382e98d032f3597: done: 0.024667 sec","job_status":"done","queue_duration_s":4.141217,"scheduling_latency_s":4.141257,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001703,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024667,"completed_at":"2026-07-28T08:19:09.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1845gitlab # [ 389.483482] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca26dd96f8fd659cc38a16e","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca26dd96f8fd659cc38a16e: start","job_status":"start","queue_duration_s":4.168031,"scheduling_latency_s":4.168069}1846gitlab # [ 389.496567] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca26dd96f8fd659cc38a16e","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca26dd96f8fd659cc38a16e: done: 0.02587 sec","job_status":"done","queue_duration_s":4.168031,"scheduling_latency_s":4.168069,"redis_calls":13,"redis_duration_s":0.002765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001714,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02587,"completed_at":"2026-07-28T08:19:09.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1847gitlab # [ 389.538999] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12f092a93169710762d1d4ef","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12f092a93169710762d1d4ef: start","job_status":"start","queue_duration_s":4.196001,"scheduling_latency_s":4.196044}1848gitlab # [ 389.552522] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.54.0" 1781849gitlab # [ 389.554734] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 2881850gitlab # [ 389.556899] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:09 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 871851gitlab # [ 389.558976] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 2061852gitlab # [ 389.561354] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1391853gitlab # [ 389.563746] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 861854gitlab # [ 389.566017] gitlab-workhorse[1293]: time="2026-07-28T08:19:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491855gitlab # [ 389.567886] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 2391856gitlab # [ 389.570036] gitaly[1368]: time="2026-07-28T08:19:09.667Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWSMG0EVEN0FVCT00JDQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-07-28T08:19:39.555" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:09.656" grpc.time_ms=11.41 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 389.586306] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12f092a93169710762d1d4ef","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12f092a93169710762d1d4ef: done: 0.02891 sec","job_status":"done","queue_duration_s":4.196001,"scheduling_latency_s":4.196044,"redis_calls":13,"redis_duration_s":0.004136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001684,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002452,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02891,"completed_at":"2026-07-28T08:19:09.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1858gitlab # [ 389.642662] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b754075e5ddb2895ba7b988d","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b754075e5ddb2895ba7b988d: start","job_status":"start","queue_duration_s":4.227109,"scheduling_latency_s":4.227151}1859gitlab # [ 389.663673] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b754075e5ddb2895ba7b988d","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b754075e5ddb2895ba7b988d: done: 0.028388 sec","job_status":"done","queue_duration_s":4.227109,"scheduling_latency_s":4.227151,"redis_calls":13,"redis_duration_s":0.0031209999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001246,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028388,"completed_at":"2026-07-28T08:19:09.681Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1860gitlab # [ 389.728473] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2434a4844ad4256c2df64cb","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2434a4844ad4256c2df64cb: start","job_status":"start","queue_duration_s":4.257628,"scheduling_latency_s":4.257664}1861gitlab # [ 389.742181] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2434a4844ad4256c2df64cb","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2434a4844ad4256c2df64cb: done: 0.030411 sec","job_status":"done","queue_duration_s":4.257628,"scheduling_latency_s":4.257664,"redis_calls":13,"redis_duration_s":0.004163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001304,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030411,"completed_at":"2026-07-28T08:19:09.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1862gitlab # [ 389.789771] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"579ca32bb5f9373eb9902a7a","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-579ca32bb5f9373eb9902a7a: start","job_status":"start","queue_duration_s":4.290235,"scheduling_latency_s":4.290272}1863gitlab # [ 389.803452] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"579ca32bb5f9373eb9902a7a","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-579ca32bb5f9373eb9902a7a: done: 0.025876 sec","job_status":"done","queue_duration_s":4.290235,"scheduling_latency_s":4.290272,"redis_calls":13,"redis_duration_s":0.0029119999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001151,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025876,"completed_at":"2026-07-28T08:19:09.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1864gitlab # [ 389.846225] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d486a2fd7e368f38fa315103","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d486a2fd7e368f38fa315103: start","job_status":"start","queue_duration_s":4.318121,"scheduling_latency_s":4.318157}1865gitlab # [ 389.859650] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d486a2fd7e368f38fa315103","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d486a2fd7e368f38fa315103: done: 0.020387 sec","job_status":"done","queue_duration_s":4.318121,"scheduling_latency_s":4.318157,"redis_calls":13,"redis_duration_s":0.001812,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020387,"completed_at":"2026-07-28T08:19:09.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1866gitlab # [ 389.902066] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c932ec830dca98a0f628c6a","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c932ec830dca98a0f628c6a: start","job_status":"start","queue_duration_s":4.340137,"scheduling_latency_s":4.34017}1867gitlab # [ 389.915637] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c932ec830dca98a0f628c6a","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c932ec830dca98a0f628c6a: done: 0.019557 sec","job_status":"done","queue_duration_s":4.340137,"scheduling_latency_s":4.34017,"redis_calls":13,"redis_duration_s":0.00207,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019557,"completed_at":"2026-07-28T08:19:09.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1868gitlab # [ 389.958272] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5690b62b36f7735eb646ed","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5690b62b36f7735eb646ed: start","job_status":"start","queue_duration_s":4.361449,"scheduling_latency_s":4.361483}1869gitlab # [ 389.971754] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5690b62b36f7735eb646ed","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5690b62b36f7735eb646ed: done: 0.033985 sec","job_status":"done","queue_duration_s":4.361449,"scheduling_latency_s":4.361483,"redis_calls":13,"redis_duration_s":0.006533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003754,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033985,"completed_at":"2026-07-28T08:19:09.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1870gitlab # [ 390.012695] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbc19aae2bfd481906df8ada","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbc19aae2bfd481906df8ada: start","job_status":"start","queue_duration_s":4.397519,"scheduling_latency_s":4.397556}1871gitlab # [ 390.027558] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbc19aae2bfd481906df8ada","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbc19aae2bfd481906df8ada: done: 0.027533 sec","job_status":"done","queue_duration_s":4.397519,"scheduling_latency_s":4.397556,"redis_calls":13,"redis_duration_s":0.0035050000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002383,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027533,"completed_at":"2026-07-28T08:19:09.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1872gitlab # [ 390.072088] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffa3ee3bf6a0a299db88ce42","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffa3ee3bf6a0a299db88ce42: start","job_status":"start","queue_duration_s":4.427186,"scheduling_latency_s":4.427221}1873gitlab # [ 390.085210] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffa3ee3bf6a0a299db88ce42","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffa3ee3bf6a0a299db88ce42: done: 0.035388 sec","job_status":"done","queue_duration_s":4.427186,"scheduling_latency_s":4.427221,"redis_calls":13,"redis_duration_s":0.004759,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035388,"completed_at":"2026-07-28T08:19:09.889Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1874gitlab # [ 390.131389] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6559d3babea12e332fa88060","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6559d3babea12e332fa88060: start","job_status":"start","queue_duration_s":4.465693,"scheduling_latency_s":4.46573}1875gitlab # [ 390.153420] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6559d3babea12e332fa88060","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6559d3babea12e332fa88060: done: 0.028074 sec","job_status":"done","queue_duration_s":4.465693,"scheduling_latency_s":4.46573,"redis_calls":13,"redis_duration_s":0.003894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028074,"completed_at":"2026-07-28T08:19:09.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1876gitlab # [ 390.196101] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c83812c053980693907c31e6","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c83812c053980693907c31e6: start","job_status":"start","queue_duration_s":4.496275,"scheduling_latency_s":4.496317}1877gitlab # [ 390.210003] nixbot[4283]: {"ts": "2026-07-28T08:19:09.941Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1878gitlab # [ 390.212845] nixbot[4283]: {"ts": "2026-07-28T08:19:09.949Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1879gitlab # [ 390.215671] gitaly[1368]: time="2026-07-28T08:19:09.690Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWSMG0EVEN0FVCT00JDQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:39.589" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:09.689" grpc.time_ms=0.872 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880gitlab # [ 390.230076] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c83812c053980693907c31e6","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c83812c053980693907c31e6: done: 0.026937 sec","job_status":"done","queue_duration_s":4.496275,"scheduling_latency_s":4.496317,"redis_calls":13,"redis_duration_s":0.003208,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026937,"completed_at":"2026-07-28T08:19:09.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1881gitlab # [ 390.270706] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11f556a73d1f8f3ef34b1483","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11f556a73d1f8f3ef34b1483: start","job_status":"start","queue_duration_s":4.525297,"scheduling_latency_s":4.525335}1882gitlab # [ 390.283658] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11f556a73d1f8f3ef34b1483","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11f556a73d1f8f3ef34b1483: done: 0.026368 sec","job_status":"done","queue_duration_s":4.525297,"scheduling_latency_s":4.525335,"redis_calls":13,"redis_duration_s":0.002869,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026368,"completed_at":"2026-07-28T08:19:09.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1883gitlab # [ 390.329906] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:09.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0b3ce7a9f28eb998427926","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0b3ce7a9f28eb998427926: start","job_status":"start","queue_duration_s":4.553832,"scheduling_latency_s":4.553871}1884gitlab # [ 390.343791] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0b3ce7a9f28eb998427926","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0b3ce7a9f28eb998427926: done: 0.045145 sec","job_status":"done","queue_duration_s":4.553832,"scheduling_latency_s":4.553871,"redis_calls":13,"redis_duration_s":0.010981000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002793,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045145,"completed_at":"2026-07-28T08:19:10.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1885gitlab # [ 390.386677] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a93eaa9d0400b79b956fbc4","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a93eaa9d0400b79b956fbc4: start","job_status":"start","queue_duration_s":4.601778,"scheduling_latency_s":4.601819}1886gitlab # [ 390.399671] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a93eaa9d0400b79b956fbc4","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a93eaa9d0400b79b956fbc4: done: 0.041417 sec","job_status":"done","queue_duration_s":4.601778,"scheduling_latency_s":4.601819,"redis_calls":13,"redis_duration_s":0.009625,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001748,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041417,"completed_at":"2026-07-28T08:19:10.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1887gitlab # [ 390.440828] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd8345a6e307cc8a8ea79a9","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd8345a6e307cc8a8ea79a9: start","job_status":"start","queue_duration_s":4.645518,"scheduling_latency_s":4.645556}1888gitlab # [ 390.454092] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd8345a6e307cc8a8ea79a9","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd8345a6e307cc8a8ea79a9: done: 0.039151 sec","job_status":"done","queue_duration_s":4.645518,"scheduling_latency_s":4.645556,"redis_calls":13,"redis_duration_s":0.009598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039151,"completed_at":"2026-07-28T08:19:10.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1889gitlab # [ 390.495018] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdc014d80a6dea82417b8dd5","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdc014d80a6dea82417b8dd5: start","job_status":"start","queue_duration_s":4.686805,"scheduling_latency_s":4.686843}1890gitlab # [ 390.511913] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdc014d80a6dea82417b8dd5","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdc014d80a6dea82417b8dd5: done: 0.037037 sec","job_status":"done","queue_duration_s":4.686805,"scheduling_latency_s":4.686843,"redis_calls":13,"redis_duration_s":0.005999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001736,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004263,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037037,"completed_at":"2026-07-28T08:19:10.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1891gitlab # [ 390.554823] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf99dc6f7078ae5021467767","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf99dc6f7078ae5021467767: start","job_status":"start","queue_duration_s":4.726023,"scheduling_latency_s":4.726061}1892gitlab # To http://gitlab/root/test-flake.git1893gitlab # 0c133b5..447dd2a master -> master1894gitlab # [ 390.568697] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf99dc6f7078ae5021467767","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf99dc6f7078ae5021467767: done: 0.026383 sec","job_status":"done","queue_duration_s":4.726023,"scheduling_latency_s":4.726061,"redis_calls":13,"redis_duration_s":0.002887,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026383,"completed_at":"2026-07-28T08:19:10.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1895gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 2.48 seconds)1896gitlab # [ 390.617721] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0841fb534f1ef3b5720e3c5","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0841fb534f1ef3b5720e3c5: start","job_status":"start","queue_duration_s":4.754508,"scheduling_latency_s":4.754544}1897gitlab: must succeed: git -C /tmp/test-flake rev-parse master1898gitlab # [ 390.631152] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0841fb534f1ef3b5720e3c5","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0841fb534f1ef3b5720e3c5: done: 0.028269 sec","job_status":"done","queue_duration_s":4.754508,"scheduling_latency_s":4.754544,"redis_calls":13,"redis_duration_s":0.003108,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028269,"completed_at":"2026-07-28T08:19:10.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1899gitlab # [ 390.668047] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d1ad970c635208a4be6a2c3","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d1ad970c635208a4be6a2c3: start","job_status":"start","queue_duration_s":4.78503,"scheduling_latency_s":4.785068}1900gitlab # [ 390.679666] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d1ad970c635208a4be6a2c3","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d1ad970c635208a4be6a2c3: done: 0.026851 sec","job_status":"done","queue_duration_s":4.78503,"scheduling_latency_s":4.785068,"redis_calls":13,"redis_duration_s":0.0029820000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001137,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026851,"completed_at":"2026-07-28T08:19:10.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1901gitlab # [ 390.718613] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d7a6ab3de3a8d5e8af04154","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d7a6ab3de3a8d5e8af04154: start","job_status":"start","queue_duration_s":4.814147,"scheduling_latency_s":4.814184}1902gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.05 seconds)1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'1904gitlab # [ 390.731626] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d7a6ab3de3a8d5e8af04154","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d7a6ab3de3a8d5e8af04154: done: 0.028589 sec","job_status":"done","queue_duration_s":4.814147,"scheduling_latency_s":4.814184,"redis_calls":13,"redis_duration_s":0.0032040000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00138,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028589,"completed_at":"2026-07-28T08:19:10.269Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1905gitlab # [ 390.777040] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a18d7ad224ba63d5f16ffda","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a18d7ad224ba63d5f16ffda: start","job_status":"start","queue_duration_s":4.844788,"scheduling_latency_s":4.844822}1906gitlab # [ 390.790399] gitlab-workhorse[1293]: time="2026-07-28T08:19:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241907gitlab # [ 390.792516] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.54.0" 2141908gitlab # [ 390.794494] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1881909gitlab # [ 390.796672] gitlab-workhorse[1293]: time="2026-07-28T08:19:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671910gitlab # [ 390.798580] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 2591911gitlab # [ 390.800563] gitlab-workhorse[1293]: time="2026-07-28T08:19:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521912gitlab # [ 390.802464] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:11 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 14881913gitlab # [ 390.804516] gitaly[1368]: time="2026-07-28T08:19:09.709Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWSMG0EVEN0FVCT00JDQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-28T08:19:19.008" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:09.698" grpc.time_ms=10.146 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.08 seconds)1915gitlab # [ 390.818511] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a18d7ad224ba63d5f16ffda","created_at":"2026-07-28T08:19:04.930Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-b21884c1a74f4392","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"20d1796e44f4f647e80e2ed80065e283","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:05.426Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a18d7ad224ba63d5f16ffda: done: 0.028921 sec","job_status":"done","queue_duration_s":4.844788,"scheduling_latency_s":4.844822,"redis_calls":13,"redis_duration_s":0.003309,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028921,"completed_at":"2026-07-28T08:19:10.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1916gitlab # [ 390.859222] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:10.302Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"7c26e17d3ce3791f9f1d91ce","created_at":"2026-07-28T08:19:06.045Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-da3263734f8a43df","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:06.054Z","job_size_bytes":46,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7c26e17d3ce3791f9f1d91ce: start","job_status":"start","queue_duration_s":4.247936,"scheduling_latency_s":4.247974}1917gitlab # [ 390.876616] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:11.301Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"7c26e17d3ce3791f9f1d91ce","created_at":"2026-07-28T08:19:06.045Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-da3263734f8a43df","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:06.054Z","job_size_bytes":46,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7c26e17d3ce3791f9f1d91ce: done: 0.998807 sec","job_status":"done","queue_duration_s":4.247936,"scheduling_latency_s":4.247974,"gitaly_calls":2,"gitaly_duration_s":0.283006,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.045719,"redis_read_bytes":68,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001711,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.002072,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.01626,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.013411,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":754,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.012265,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.311,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.068,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.068,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.311,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.234172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00153724,"duration_s":0.998807,"completed_at":"2026-07-28T08:19:11.301Z","load_balancing_strategy":"primary","db_duration_s":0.596816,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1918gitlab # [ 390.926332] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:11.306Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"3b3a84b0053456ba3fea7f14","created_at":"2026-07-28T08:19:06.084Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-da3263734f8a43df","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:06.097Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-3b3a84b0053456ba3fea7f14: start","job_status":"start","queue_duration_s":5.209348,"scheduling_latency_s":5.209385}1919gitlab # [ 390.943394] gitaly[1368]: time="2026-07-28T08:19:10.137Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWT33PM7ZFYFKSC2XYRW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.126" grpc.time_ms=10.767 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1920gitlab # [ 390.957189] gitaly[1368]: time="2026-07-28T08:19:10.378Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWT5V8PS61K1BZ7BXK4TH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.354" pid=1368 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1921gitlab # [ 390.967657] gitlab-workhorse[1293]: time="2026-07-28T08:19:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3421922gitlab # [ 390.970926] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 342 "" "git/2.54.0" 5371923gitlab # [ 390.972971] nixbot[4283]: INFO: ::ffff:127.0.0.1:33148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK1924gitlab # [ 390.974957] gitaly[1368]: time="2026-07-28T08:19:10.378Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWT5V8PS61K1BZ7BXK4TH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.354" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925gitlab # [ 390.988810] gitaly[1368]: time="2026-07-28T08:19:10.378Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWT5V8PS61K1BZ7BXK4TH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.354" grpc.time_ms=23.717 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1926gitlab # [ 391.003585] gitaly[1368]: time="2026-07-28T08:19:10.438Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-07-28T14:19:10.433" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:10.433" grpc.time_ms=3.876 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927gitlab # [ 391.014590] gitaly[1368]: time="2026-07-28T08:19:10.599Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWTDJTM1SZ4026BNSDHA0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.567" pid=1368 remote_ip="2001:db8:1::1" request_sha=3926a4be3c4c86fb9c76cc2c2ff840ad47f0719d response_bytes=224 span.kind=server system=grpc1928gitlab # [ 391.025089] gitaly[1368]: time="2026-07-28T08:19:10.599Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=12 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWTDJTM1SZ4026BNSDHA0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.567" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1929gitlab # [ 391.039146] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 961930gitlab # [ 391.041401] gitaly[1368]: time="2026-07-28T08:19:10.599Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=12 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWTDJTM1SZ4026BNSDHA0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.567" grpc.time_ms=32.072 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1931gitlab # [ 391.056709] gitaly[1368]: time="2026-07-28T08:19:10.623Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-28T08:19:20.009" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:10.609" grpc.time_ms=14.319 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 391.070833] gitaly[1368]: time="2026-07-28T08:19:10.649Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=20 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-28T08:19:40.320" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:10.621" grpc.time_ms=28.018 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 391.084498] gitaly[1368]: time="2026-07-28T08:19:10.717Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-28T08:19:40.004" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-28T08:19:10.704" grpc.time_ms=12.174 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab # [ 391.099184] gitaly[1368]: time="2026-07-28T08:19:10.794Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 duration_ms=377ns method=POST pid=1368 status=200 url="http://unix/api/v4/internal/allowed"1935gitlab # [ 391.102187] gitaly[1368]: time="2026-07-28T08:19:10.851Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 duration_ms=56ns method=POST pid=1368 status=200 url="http://unix/api/v4/internal/pre_receive"1936gitlab # [ 391.105170] gitaly[1368]: time="2026-07-28T08:19:10.852Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5317 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:10.415" grpc.time_ms=436.603 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1937gitlab # [ 391.115683] gitaly[1368]: time="2026-07-28T08:19:10.904Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:10.904" grpc.time_ms=0.774 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1938gitlab # [ 391.127019] gitaly[1368]: time="2026-07-28T08:19:10.927Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWTRKDWTKTKMKCW5M6226 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.909" grpc.time_ms=17.302 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1939gitlab # [ 391.141161] gitlab-workhorse[1293]: time="2026-07-28T08:19:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2141940gitlab # [ 391.143068] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 214 "" "git/2.54.0" 1091941gitlab # [ 391.145137] gitaly[1368]: time="2026-07-28T08:19:10.971Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:10.970" grpc.time_ms=0.924 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1942gitlab # [ 391.156161] gitaly[1368]: time="2026-07-28T08:19:11.061Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:11.060" grpc.time_ms=0.714 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1943gitlab # [ 391.167134] gitaly[1368]: time="2026-07-28T08:19:11.189Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWTYKPGGXXVR5D6264HK7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.145" pid=1368 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1944gitlab # [ 391.179004] gitaly[1368]: time="2026-07-28T08:19:11.190Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=42 command.spawn_token_fork_ms=10 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWTYKPGGXXVR5D6264HK7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.145" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1945gitlab # [ 391.192925] gitaly[1368]: time="2026-07-28T08:19:11.190Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=42 command.spawn_token_fork_ms=10 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWTYKPGGXXVR5D6264HK7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.145" grpc.time_ms=44.782 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1946gitlab # [ 391.207691] gitaly[1368]: time="2026-07-28T08:19:11.379Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 duration_ms=265ns method=POST pid=1368 status=200 url="http://unix/api/v4/internal/post_receive"1947gitlab # [ 391.210819] gitaly[1368]: time="2026-07-28T08:19:11.380Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4811 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:11.114" grpc.time_ms=266.205 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1948gitlab # [ 391.221960] gitaly[1368]: time="2026-07-28T08:19:11.396Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 diskcache=429c4599-0927-48ae-ab68-e3a2cfb0d16e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.039" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1949gitlab # [ 391.232542] gitaly[1368]: time="2026-07-28T08:19:11.396Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=185 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13127 command.oublock=32 command.real_time_ms=1344 command.spawn_token_fork_ms=1 command.system_time_ms=103 command.user_time_ms=82 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=604 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:10.039" grpc.time_ms=1357.079 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1950gitlab # [ 391.246391] gitaly[1368]: time="2026-07-28T08:19:11.450Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY diskcache=0ff9812b-e962-4802-9db8-9e94dfe0f00d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-28T14:19:11.364" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:11.364" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 391.256696] gitaly[1368]: time="2026-07-28T08:19:11.450Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1178 command.oublock=0 command.real_time_ms=119 command.spawn_token_fork_ms=46 command.system_time_ms=4 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-28T14:19:11.364" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:11.364" grpc.time_ms=85.362 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab # [ 391.272249] gitaly[1368]: time="2026-07-28T08:19:11.730Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWV6S9JAQB0DFBAF3CYER grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.696" pid=1368 remote_ip="2001:db8:1::1" request_sha=b945f712e29f908c42da49c0c1e6053f22e1f1a4 response_bytes=342 span.kind=server system=grpc1953gitlab # [ 391.282549] gitaly[1368]: time="2026-07-28T08:19:11.730Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=13 command.system_time_ms=12 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWV6S9JAQB0DFBAF3CYER grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.696" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1954gitlab # [ 391.296784] gitaly[1368]: time="2026-07-28T08:19:11.731Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=13 command.system_time_ms=12 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWV6S9JAQB0DFBAF3CYER grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.696" grpc.time_ms=34.553 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1955gitlab # [ 391.311963] gitaly[1368]: time="2026-07-28T08:19:11.883Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=7 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWVSA4KND951R6YM1VSRG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.867" grpc.time_ms=15.353 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1956gitlab # [ 391.325677] gitaly[1368]: time="2026-07-28T08:19:11.994Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWVWD0QMMP66MT3G08V28 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.971" pid=1368 remote_ip="2001:db8:1::1" request_sha=69dcef142412daaffeeda28f6446e517599d516e response_bytes=214 span.kind=server system=grpc1957gitlab # [ 391.336280] gitaly[1368]: time="2026-07-28T08:19:11.994Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWVWD0QMMP66MT3G08V28 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.971" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1958gitlab # [ 391.350557] gitaly[1368]: time="2026-07-28T08:19:11.994Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWVWD0QMMP66MT3G08V28 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:11.971" grpc.time_ms=23.052 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc1959gitlab # [ 391.365961] gitaly[1368]: time="2026-07-28T08:19:12.132Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:42.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:12.131" grpc.time_ms=0.624 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 391.380358] gitaly[1368]: time="2026-07-28T08:19:12.193Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-28T08:19:42.081" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:12.182" grpc.time_ms=10.642 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961gitlab # [ 391.394646] gitaly[1368]: time="2026-07-28T08:19:12.219Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:22.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:12.208" grpc.time_ms=11.559 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 391.408806] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:12.275Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"3b3a84b0053456ba3fea7f14","created_at":"2026-07-28T08:19:06.084Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-da3263734f8a43df","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:06.097Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-3b3a84b0053456ba3fea7f14: done: 0.969001 sec","job_status":"done","queue_duration_s":5.209348,"scheduling_latency_s":5.209385,"gitaly_calls":1,"gitaly_duration_s":0.173426,"redis_calls":15,"redis_duration_s":0.036994,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001934,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002216,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.025626,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.381,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.322,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.453,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.381,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.8846082,"duration_s":0.969001,"completed_at":"2026-07-28T08:19:12.275Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.678827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1963gitlab # [ 391.456742] gitaly[1368]: time="2026-07-28T08:19:12.322Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-28T08:19:22.120" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:12.321" grpc.time_ms=0.708 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1964gitlab # [ 391.467839] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:12.334Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a654815d076091e27a9399d3","created_at":"2026-07-28T08:19:06.239Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-da3263734f8a43df","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:06.242Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a654815d076091e27a9399d3: start","job_status":"start","queue_duration_s":6.092142,"scheduling_latency_s":6.092232}1965gitlab # [ 391.483944] gitaly[1368]: time="2026-07-28T08:19:12.348Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-28T08:19:22.135" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:12.336" grpc.time_ms=11.792 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 391.531812] gitaly[1368]: time="2026-07-28T08:19:12.409Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:12.408" grpc.time_ms=0.625 pid=1368 span.kind=server system=grpc1967gitlab # [ 391.577406] gitaly[1368]: time="2026-07-28T08:19:12.455Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:12.454" grpc.time_ms=0.876 pid=1368 span.kind=server system=grpc1968gitlab # [ 391.590983] gitaly[1368]: time="2026-07-28T08:19:12.468Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z diskcache=a4981e67-f9bf-4a20-87d0-1bcc496b3a45 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-28T08:19:22.152" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:12.353" pid=1368 ref=refs/keep-around/0c133b5452446e9af6444606680b063f86b87237 remote_ip="2001:db8:1::1" revision=0c133b5452446e9af6444606680b063f86b87237 span.kind=server system=grpc username=root1969gitlab # [ 391.605643] gitaly[1368]: time="2026-07-28T08:19:12.469Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=87 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4932 command.oublock=8 command.real_time_ms=106 command.spawn_token_fork_ms=2 command.system_time_ms=50 command.user_time_ms=37 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-28T08:19:22.152" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:12.353" grpc.time_ms=115.795 pid=1368 ref=refs/keep-around/0c133b5452446e9af6444606680b063f86b87237 remote_ip="2001:db8:1::1" revision=0c133b5452446e9af6444606680b063f86b87237 span.kind=server system=grpc username=root1970gitlab # [ 391.621395] gitaly[1368]: time="2026-07-28T08:19:12.475Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:42.374" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:12.475" grpc.time_ms=0.52 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1971gitlab # [ 391.634482] gitaly[1368]: time="2026-07-28T08:19:12.510Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-28T08:19:42.193" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:12.493" grpc.time_ms=16.618 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1972gitlab # [ 391.737934] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:12.613Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a654815d076091e27a9399d3","created_at":"2026-07-28T08:19:06.239Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-da3263734f8a43df","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:06.242Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a654815d076091e27a9399d3: done: 0.27867 sec","job_status":"done","queue_duration_s":6.092142,"scheduling_latency_s":6.092232,"gitaly_calls":1,"gitaly_duration_s":0.030012,"redis_calls":16,"redis_duration_s":0.033442,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.004463,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005274,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.016588,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.007117,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.092,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.092,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.27867,"completed_at":"2026-07-28T08:19:12.613Z","load_balancing_strategy":"primary","db_duration_s":0.098039,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1973gitlab # [ 391.792325] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:12.620Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f665944a0992672199c6072f","created_at":"2026-07-28T08:19:07.078Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-da3263734f8a43df","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:efa15e7a3b47b51785fb042e6f4e3ea8abbdcd4077c7ba261e20acc397742a73","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:07.092Z","job_size_bytes":467,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f665944a0992672199c6072f: start","job_status":"start","queue_duration_s":5.528546,"scheduling_latency_s":5.528605}1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'1975gitlab # [ 391.874111] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0c133b5452446e9af6444606680b063f86b87237 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 7161976gitlab # [ 391.877437] nixbot[4283]: {"ts": "2026-07-28T08:19:12.752Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0c133b5452446e9af6444606680b063f86b87237 \"HTTP/1.1 201 Created\""}1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.09 seconds)1978gitlab # [ 391.891683] gitaly[1368]: time="2026-07-28T08:19:12.769Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:42.466" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:12.767" grpc.time_ms=1.295 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 391.924491] nixbot[4283]: {"ts": "2026-07-28T08:19:12.772Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-0c133b545244-9aac0f06"}1980gitlab # [ 391.927037] nixbot[4283]: INFO: ::ffff:127.0.0.1:35706 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK1981gitlab # [ 391.936590] gitaly[1368]: time="2026-07-28T08:19:12.814Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=25 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-28T08:19:22.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:12.776" grpc.time_ms=37.115 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 391.999354] systemd[1]: Started Nix Daemon.1983gitlab # [ 392.099937] nix-daemon[4564]: accepted connection from pid 4556, user nixbot1984gitlab # [ 392.243628] nix-daemon[4564]: accepted connection from pid 4571, user nixbot1985gitlab # [ 392.277424] nixbot[4283]: {"ts": "2026-07-28T08:19:13.154Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-0c133b545244-9aac0f06", "argv0": "bwrap"}1986gitlab # [ 392.454845] nix-daemon[4564]: accepted connection from pid 4589, user nixbot1987gitlab # [ 392.482278] nix-daemon[4564]: accepted connection from pid 4588, user nixbot1988gitlab # [ 392.601594] gitaly[1368]: time="2026-07-28T08:19:13.478Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-28T08:19:43.175" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:13.475" grpc.time_ms=2 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1989gitlab # [ 392.626267] gitaly[1368]: time="2026-07-28T08:19:13.503Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=203 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-28T08:19:43.195" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:13.496" grpc.time_ms=7.449 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 392.865931] gitaly[1368]: time="2026-07-28T08:19:13.743Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:23.261" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:13.722" grpc.time_ms=20.744 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.06 seconds)1993gitlab # [ 392.978053] nixbot[4283]: INFO: ::ffff:127.0.0.1:35716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'1995gitlab # [ 394.038540] nixbot[4283]: INFO: ::ffff:127.0.0.1:35718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.06 seconds)1997gitlab # [ 394.339565] gitaly[1368]: time="2026-07-28T08:19:15.215Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=884 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=3 command.system_time_ms=20 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-28T08:19:45.082" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:15.183" grpc.time_ms=32.579 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 394.625910] gitaly[1368]: time="2026-07-28T08:19:15.503Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWKT4D02PJ9GB0WWDBPRY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-28T08:19:45.377" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:15.477" grpc.time_ms=25.724 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 394.807930] sidekiq-cluster[2497]: {"severity":"WARN","time":"2026-07-28T08:19:15.684Z","class":"CreatePipelineWorker","correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"0c133b5452446e9af6444606680b063f86b87237","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"0c133b5452446e9af6444606680b063f86b87237","ref":"refs/heads/master"},"retry":0}2000gitlab # [ 394.852812] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:15.729Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f665944a0992672199c6072f","created_at":"2026-07-28T08:19:07.078Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-da3263734f8a43df","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:efa15e7a3b47b51785fb042e6f4e3ea8abbdcd4077c7ba261e20acc397742a73","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:07.092Z","job_size_bytes":467,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f665944a0992672199c6072f: done: 3.10896 sec","job_status":"done","queue_duration_s":5.528546,"scheduling_latency_s":5.528605,"gitaly_calls":7,"gitaly_duration_s":0.44281,"redis_calls":53,"redis_duration_s":0.124879,"redis_read_bytes":171,"redis_write_bytes":4427,"redis_cache_calls":4,"redis_cache_duration_s":0.010724,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.059274,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.037564,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004653,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.335,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.272,"db_ci_duration_s":0.064,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.837445,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00438052,"duration_s":3.10896,"completed_at":"2026-07-28T08:19:15.729Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.601096,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2001gitlab # [ 394.950757] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:15.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"389a433e1605044fde1516fa","created_at":"2026-07-28T08:19:08.495Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-df4b3dab75c94564","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"93274fcf7b081720ee92856728ac2e3c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:08.517Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-389a433e1605044fde1516fa: start","job_status":"start","queue_duration_s":7.227524,"scheduling_latency_s":7.227593}2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.06 seconds)2004gitlab # [ 395.029070] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:15.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"389a433e1605044fde1516fa","created_at":"2026-07-28T08:19:08.495Z","trace_propagation_headers":{"sentry-trace":"9ada1c5ffbfc4eaf9bf8237f710859ab-df4b3dab75c94564","baggage":"sentry-trace_id=9ada1c5ffbfc4eaf9bf8237f710859ab,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"93274fcf7b081720ee92856728ac2e3c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:08.517Z","job_size_bytes":2,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-389a433e1605044fde1516fa: done: 0.160874 sec","job_status":"done","queue_duration_s":7.227524,"scheduling_latency_s":7.227593,"redis_calls":13,"redis_duration_s":0.036416,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008178,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.016079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.02,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.02,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00237368,"duration_s":0.160874,"completed_at":"2026-07-28T08:19:15.905Z","load_balancing_strategy":"primary","db_duration_s":0.019402,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2005gitlab # [ 395.107624] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:15.918Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0c133b5452446e9af6444606680b063f86b87237 447dd2a526868fb2d085dd0d3dc9ba43c2227108 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2c3dcce87fcc403b98337124","created_at":"2026-07-28T08:19:11.260Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-379d9db07fb9405f","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:11.269Z","job_size_bytes":185,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2c3dcce87fcc403b98337124: start","job_status":"start","queue_duration_s":4.648811,"scheduling_latency_s":4.648867}2006gitlab # [ 395.132654] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:15.983Z","message":"changes: \"0c133b5452446e9af6444606680b063f86b87237 447dd2a526868fb2d085dd0d3dc9ba43c2227108 refs/heads/master\\n\""}2007gitlab # [ 395.136654] nixbot[4283]: INFO: ::ffff:127.0.0.1:35730 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK2008gitlab # [ 395.214115] gitaly[1368]: time="2026-07-28T08:19:16.091Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:26.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:16.070" grpc.time_ms=21.176 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009gitlab # [ 395.260003] gitaly[1368]: time="2026-07-28T08:19:16.137Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-28T08:19:26.056" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:16.118" grpc.time_ms=19.111 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 395.376593] gitaly[1368]: time="2026-07-28T08:19:16.252Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-28T08:19:26.172" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:16.233" grpc.time_ms=19.583 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 395.424334] gitaly[1368]: time="2026-07-28T08:19:16.301Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-07-28T08:19:46.179" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:16.279" grpc.time_ms=21.771 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab # [ 395.482646] gitaly[1368]: time="2026-07-28T08:19:16.360Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-28T08:19:26.285" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-07-28T08:19:16.346" grpc.time_ms=13.564 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013gitlab # [ 395.543635] gitaly[1368]: time="2026-07-28T08:19:16.421Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:26.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:16.402" grpc.time_ms=18.366 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.06 seconds)2016gitlab # [ 396.161319] nixbot[4283]: INFO: ::ffff:127.0.0.1:35744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK2017gitlab # [ 396.191706] gitaly[1368]: time="2026-07-28T08:19:17.069Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-28T08:19:27.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:17.059" grpc.time_ms=9.798 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018gitlab # [ 396.322762] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:17.198Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0c133b5452446e9af6444606680b063f86b87237 447dd2a526868fb2d085dd0d3dc9ba43c2227108 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2c3dcce87fcc403b98337124","created_at":"2026-07-28T08:19:11.260Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-379d9db07fb9405f","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-28T08:19:11.269Z","job_size_bytes":185,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2c3dcce87fcc403b98337124: done: 1.280355 sec","job_status":"done","queue_duration_s":4.648811,"scheduling_latency_s":4.648867,"gitaly_calls":7,"gitaly_duration_s":0.199445,"redis_calls":112,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.228728,"redis_read_bytes":350,"redis_write_bytes":13067,"redis_cache_calls":9,"redis_cache_duration_s":0.029892,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005636,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.011619,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6767,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.022563,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.084147,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.074871,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.191,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.116,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.116,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.191,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.593341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00273246,"exclusive_lock_hold_duration_s":0.08458116,"duration_s":1.280355,"completed_at":"2026-07-28T08:19:17.198Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.216405,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2019gitlab # [ 396.389791] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:17.209Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"649acc22911c80e182f36f8a","created_at":"2026-07-28T08:19:11.233Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-3eb9ac008e934ba7","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:11.271Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-649acc22911c80e182f36f8a: start","job_status":"start","queue_duration_s":5.937992,"scheduling_latency_s":5.938072}2020gitlab # [ 396.602982] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:17.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"649acc22911c80e182f36f8a","created_at":"2026-07-28T08:19:11.233Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-3eb9ac008e934ba7","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:11.271Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-649acc22911c80e182f36f8a: done: 0.270023 sec","job_status":"done","queue_duration_s":5.937992,"scheduling_latency_s":5.938072,"redis_calls":19,"redis_duration_s":0.049451,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.012614,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.005403,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.025185,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.006249,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0533223,"duration_s":0.270023,"completed_at":"2026-07-28T08:19:17.479Z","load_balancing_strategy":"primary","db_duration_s":0.037995,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021gitlab # [ 396.661615] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:17.491Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1354bad8b05e21fd8edaf306","created_at":"2026-07-28T08:19:12.489Z","trace_propagation_headers":{"sentry-trace":"bb68a6db79a141e29bb1c5cd19a366ac-c8f6c84fae8e46f3","baggage":"sentry-trace_id=bb68a6db79a141e29bb1c5cd19a366ac,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWW11Q8Y687TZZN8C227Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:12.499Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1354bad8b05e21fd8edaf306: start","job_status":"start","queue_duration_s":4.991853,"scheduling_latency_s":4.991919}2022gitlab # [ 396.761672] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:17.638Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1354bad8b05e21fd8edaf306","created_at":"2026-07-28T08:19:12.489Z","trace_propagation_headers":{"sentry-trace":"bb68a6db79a141e29bb1c5cd19a366ac-c8f6c84fae8e46f3","baggage":"sentry-trace_id=bb68a6db79a141e29bb1c5cd19a366ac,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWW11Q8Y687TZZN8C227Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:12.499Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1354bad8b05e21fd8edaf306: done: 0.147244 sec","job_status":"done","queue_duration_s":4.991853,"scheduling_latency_s":4.991919,"redis_calls":18,"redis_duration_s":0.01047,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.005735,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00105726,"duration_s":0.147244,"completed_at":"2026-07-28T08:19:17.638Z","load_balancing_strategy":"primary","db_duration_s":0.029247,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2023gitlab # [ 396.844457] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:17.642Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b948638829c7b4029d9bbafd","created_at":"2026-07-28T08:19:12.500Z","trace_propagation_headers":{"sentry-trace":"bb68a6db79a141e29bb1c5cd19a366ac-c8f6c84fae8e46f3","baggage":"sentry-trace_id=bb68a6db79a141e29bb1c5cd19a366ac,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWW11Q8Y687TZZN8C227Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:12.510Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b948638829c7b4029d9bbafd: start","job_status":"start","queue_duration_s":5.131873,"scheduling_latency_s":5.131926}2024gitlab # [ 396.910957] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:17.787Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b948638829c7b4029d9bbafd","created_at":"2026-07-28T08:19:12.500Z","trace_propagation_headers":{"sentry-trace":"bb68a6db79a141e29bb1c5cd19a366ac-c8f6c84fae8e46f3","baggage":"sentry-trace_id=bb68a6db79a141e29bb1c5cd19a366ac,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWW11Q8Y687TZZN8C227Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:12.510Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b948638829c7b4029d9bbafd: done: 0.145414 sec","job_status":"done","queue_duration_s":5.131873,"scheduling_latency_s":5.131926,"redis_calls":15,"redis_duration_s":0.007249,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00146,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003038,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00081334,"duration_s":0.145414,"completed_at":"2026-07-28T08:19:17.787Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 397.004002] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:17.792Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"05352f42372db90e4a1da475","created_at":"2026-07-28T08:19:12.705Z","trace_propagation_headers":{"sentry-trace":"bb68a6db79a141e29bb1c5cd19a366ac-c8f6c84fae8e46f3","baggage":"sentry-trace_id=bb68a6db79a141e29bb1c5cd19a366ac,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWW11Q8Y687TZZN8C227Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:12.717Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-05352f42372db90e4a1da475: start","job_status":"start","queue_duration_s":5.075182,"scheduling_latency_s":5.075248}2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'2027gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.06 seconds)2028gitlab # [ 397.213223] gitaly[1368]: time="2026-07-28T08:19:18.088Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-28T08:19:48.085" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.085" grpc.time_ms=2.69 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab # [ 397.250245] gitaly[1368]: time="2026-07-28T08:19:18.111Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:48.002" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.102" grpc.time_ms=7.794 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030gitlab # [ 397.274808] nixbot[4283]: INFO: ::ffff:127.0.0.1:35754 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK2031gitlab # [ 397.318157] gitaly[1368]: time="2026-07-28T08:19:18.195Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:48.193" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.193" grpc.time_ms=1.495 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2032gitlab # [ 397.389400] gitaly[1368]: time="2026-07-28T08:19:18.267Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWW11Q8Y687TZZN8C227Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:48.263" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.263" grpc.time_ms=3.111 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2033gitlab # [ 397.422596] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:18.293Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"05352f42372db90e4a1da475","created_at":"2026-07-28T08:19:12.705Z","trace_propagation_headers":{"sentry-trace":"bb68a6db79a141e29bb1c5cd19a366ac-c8f6c84fae8e46f3","baggage":"sentry-trace_id=bb68a6db79a141e29bb1c5cd19a366ac,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWW11Q8Y687TZZN8C227Z","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:12.717Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-05352f42372db90e4a1da475: done: 0.50064 sec","job_status":"done","queue_duration_s":5.075182,"scheduling_latency_s":5.075248,"gitaly_calls":3,"gitaly_duration_s":0.025546,"redis_calls":48,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.024199000000000002,"redis_read_bytes":208,"redis_write_bytes":6803,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.003477,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002756,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.004562,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000821,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.004256,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001858,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000426,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002566,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.082,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.021,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.029,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.036,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.369621,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.4130418,"duration_s":0.50064,"completed_at":"2026-07-28T08:19:18.293Z","load_balancing_strategy":"primary","db_duration_s":0.102907,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2034gitlab # [ 397.492502] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:18.297Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"90cc7a5a682391a2f4a52e06","created_at":"2026-07-28T08:19:16.156Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-84d7d387e20b47ba","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:16.176Z","job_size_bytes":46,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-90cc7a5a682391a2f4a52e06: start","job_status":"start","queue_duration_s":2.120213,"scheduling_latency_s":2.120258}2035gitlab # [ 397.509346] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:18.338Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"90cc7a5a682391a2f4a52e06","created_at":"2026-07-28T08:19:16.156Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-84d7d387e20b47ba","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:16.176Z","job_size_bytes":46,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-90cc7a5a682391a2f4a52e06: done: 0.041344 sec","job_status":"done","queue_duration_s":2.120213,"scheduling_latency_s":2.120258,"redis_calls":9,"redis_duration_s":0.003625,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000364,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041344,"completed_at":"2026-07-28T08:19:18.338Z","load_balancing_strategy":"primary","db_duration_s":0.004094,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2036gitlab # [ 397.567064] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:18.340Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"37e9a1e2bbf38e9b163fdf1e","created_at":"2026-07-28T08:19:16.196Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-84d7d387e20b47ba","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:16.207Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-37e9a1e2bbf38e9b163fdf1e: start","job_status":"start","queue_duration_s":2.133175,"scheduling_latency_s":2.133217}2037gitlab # [ 397.586498] gitaly[1368]: time="2026-07-28T08:19:18.307Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:28.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:18.290" grpc.time_ms=16.465 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 397.601303] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:18.426Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"37e9a1e2bbf38e9b163fdf1e","created_at":"2026-07-28T08:19:16.196Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-84d7d387e20b47ba","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:16.207Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-37e9a1e2bbf38e9b163fdf1e: done: 0.085766 sec","job_status":"done","queue_duration_s":2.133175,"scheduling_latency_s":2.133217,"gitaly_calls":1,"gitaly_duration_s":0.022397,"redis_calls":12,"redis_duration_s":0.003873,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001605,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000699,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001569,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05231516,"duration_s":0.085766,"completed_at":"2026-07-28T08:19:18.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2039gitlab # [ 397.646673] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:18.428Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"04043bb016d199a91b766760","created_at":"2026-07-28T08:19:16.688Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-84d7d387e20b47ba","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f4f77674ad67a8dc92b561ea323b8c8591082a176941cec18df79bade425901f","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:16.703Z","job_size_bytes":467,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-04043bb016d199a91b766760: start","job_status":"start","queue_duration_s":1.725566,"scheduling_latency_s":1.725602}2040gitlab # [ 397.664285] gitaly[1368]: time="2026-07-28T08:19:18.393Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 diskcache=cbdeddbd-1f2f-416d-a736-e45796ab1d98 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-28T14:19:18.373" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.374" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 397.674064] gitaly[1368]: time="2026-07-28T08:19:18.393Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-28T14:19:18.373" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.374" grpc.time_ms=18.954 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 397.687861] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0c133b5452446e9af6444606680b063f86b87237 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 5382043gitlab # [ 397.690664] nixbot[4283]: {"ts": "2026-07-28T08:19:18.521Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0c133b5452446e9af6444606680b063f86b87237 \"HTTP/1.1 201 Created\""}2044gitlab # [ 397.693590] gitaly[1368]: time="2026-07-28T08:19:18.473Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:48.471" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.472" grpc.time_ms=0.95 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045gitlab # [ 397.706402] gitaly[1368]: time="2026-07-28T08:19:18.488Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-28T08:19:28.076" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:18.477" grpc.time_ms=10.742 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046gitlab # [ 397.719980] gitaly[1368]: time="2026-07-28T08:19:18.563Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-28T08:19:48.561" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.561" grpc.time_ms=1.242 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047gitlab # [ 397.733041] gitaly[1368]: time="2026-07-28T08:19:18.573Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=129 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-28T08:19:48.568" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.568" grpc.time_ms=4.454 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 397.749664] gitaly[1368]: time="2026-07-28T08:19:18.621Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX2C417X5DRZQ697AB6XT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:48.517" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.619" grpc.time_ms=2.076 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049gitlab # [ 397.772474] gitaly[1368]: time="2026-07-28T08:19:18.650Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:28.236" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:18.637" grpc.time_ms=12.646 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2050gitlab # [ 397.816068] gitaly[1368]: time="2026-07-28T08:19:18.693Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX2C417X5DRZQ697AB6XT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:28.080" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:18.681" grpc.time_ms=12.085 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 397.898577] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0c133b5452446e9af6444606680b063f86b87237 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2432052gitlab # [ 397.906456] nixbot[4283]: {"ts": "2026-07-28T08:19:18.777Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0c133b5452446e9af6444606680b063f86b87237 \"HTTP/1.1 201 Created\""}2053gitlab # [ 397.998327] gitaly[1368]: time="2026-07-28T08:19:18.875Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX2M8P4026DJ8KJQ90H9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:48.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:18.874" grpc.time_ms=1.187 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 398.077540] gitaly[1368]: time="2026-07-28T08:19:18.954Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX2M8P4026DJ8KJQ90H9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:28.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:18.934" grpc.time_ms=20.172 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'2056gitlab # [ 398.231749] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0c133b5452446e9af6444606680b063f86b87237 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3162057gitlab # [ 398.239442] nixbot[4283]: {"ts": "2026-07-28T08:19:19.111Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0c133b5452446e9af6444606680b063f86b87237 \"HTTP/1.1 201 Created\""}2058gitlab # [ 398.294271] nixbot[4283]: INFO: ::ffff:127.0.0.1:35770 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK2059gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.08 seconds)2060gitlab # [ 398.409035] nix-daemon[4564]: accepted connection from pid 4660, user nixbot2061gitlab # [ 398.619576] gitaly[1368]: time="2026-07-28T08:19:19.495Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX365Z8SAJPRQ645JJ8DW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:19.477" grpc.time_ms=17.217 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc2062gitlab # [ 398.638457] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1302063gitlab # [ 398.733575] gitaly[1368]: time="2026-07-28T08:19:19.611Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX3ABZ7ZK6YFNQZ0QABY7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:19.595" pid=1368 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc2064gitlab # [ 398.765460] gitaly[1368]: time="2026-07-28T08:19:19.638Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX3ABZ7ZK6YFNQZ0QABY7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:19.595" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc2065gitlab # [ 398.796727] gitlab-workhorse[1293]: time="2026-07-28T08:19:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672066gitlab # [ 398.800908] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 1402067gitlab # [ 398.805220] gitaly[1368]: time="2026-07-28T08:19:19.639Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX3ABZ7ZK6YFNQZ0QABY7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:19.595" grpc.time_ms=44.022 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc2068gitlab # [ 398.948460] nix-daemon[4564]: accepted connection from pid 4685, user nixbot2069gitlab # [ 399.035552] gitaly[1368]: time="2026-07-28T08:19:19.913Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=884 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-28T08:19:49.880" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:19.880" grpc.time_ms=32.056 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 399.075903] gitaly[1368]: time="2026-07-28T08:19:19.949Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYKWWSYMAG9QSPH1A1FDK1N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-28T08:19:49.019" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:19.920" grpc.time_ms=29.302 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 399.109529] sidekiq-cluster[2497]: {"severity":"WARN","time":"2026-07-28T08:19:19.985Z","class":"CreatePipelineWorker","correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0c133b5452446e9af6444606680b063f86b87237","after":"447dd2a526868fb2d085dd0d3dc9ba43c2227108","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"447dd2a526868fb2d085dd0d3dc9ba43c2227108","ref":"refs/heads/master"},"retry":0}2072gitlab # [ 399.125771] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:20.002Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"04043bb016d199a91b766760","created_at":"2026-07-28T08:19:16.688Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-84d7d387e20b47ba","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f4f77674ad67a8dc92b561ea323b8c8591082a176941cec18df79bade425901f","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:16.703Z","job_size_bytes":467,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-04043bb016d199a91b766760: done: 1.573623 sec","job_status":"done","queue_duration_s":1.725566,"scheduling_latency_s":1.725602,"gitaly_calls":7,"gitaly_duration_s":0.123065,"redis_calls":33,"redis_duration_s":0.012426,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001302,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.006926,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002027,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.131559,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.573623,"completed_at":"2026-07-28T08:19:20.002Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.067007,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2073gitlab # [ 399.198896] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:20.007Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"d9ccb4f3-85e7-43c9-a54d-41ad4da9b70d\"}"],"class":"WebHookWorker","jid":"793514532ee75c643a79331c","created_at":"2026-07-28T08:19:16.962Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-84d7d387e20b47ba","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:612db98113efe9fd3e94bbf6c1c3080ce4e9b1ef827d97dfbee82f5f350589dd","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:16.993Z","job_size_bytes":1749,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-793514532ee75c643a79331c: start","job_status":"start","queue_duration_s":3.013953,"scheduling_latency_s":3.014012}2074gitlab # [ 399.281191] nixbot[4283]: INFO: ::ffff:127.0.0.1:35772 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2075gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'2076gitlab # [ 399.336495] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:20.210Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"d9ccb4f3-85e7-43c9-a54d-41ad4da9b70d\"}"],"class":"WebHookWorker","jid":"793514532ee75c643a79331c","created_at":"2026-07-28T08:19:16.962Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-84d7d387e20b47ba","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:612db98113efe9fd3e94bbf6c1c3080ce4e9b1ef827d97dfbee82f5f350589dd","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:16.993Z","job_size_bytes":1749,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-793514532ee75c643a79331c: done: 0.203401 sec","job_status":"done","queue_duration_s":3.013953,"scheduling_latency_s":3.014012,"redis_calls":19,"redis_duration_s":0.009771,"redis_read_bytes":31,"redis_write_bytes":5281,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00235,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000951,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3643,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004249,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002221,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.015878460000010364,"cpu_s":0.156949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009882,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.203401,"completed_at":"2026-07-28T08:19:20.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005231,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2077gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.13 seconds)2078gitlab # [ 399.419832] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:20.214Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"66bbdd5e3f53428b7d346075","created_at":"2026-07-28T08:18:56.989Z","trace_propagation_headers":{"sentry-trace":"4101292b5ae444259c4c14323725c656-395f930e52b44c40","baggage":"sentry-trace_id=4101292b5ae444259c4c14323725c656,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWCJGD508F89N2VSYQRW5","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:3a632123e127d48afd25738715c661884812a5934efac71dd77cc77811555017","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:19.765Z","retry_count":0,"job_size_bytes":451,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-66bbdd5e3f53428b7d346075: start","job_status":"start","queue_duration_s":0.448735,"scheduling_latency_s":0.448792}2079gitlab # [ 399.444291] sidekiq-cluster[2497]: {"severity":"WARN","time":"2026-07-28T08:19:20.291Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"66bbdd5e3f53428b7d346075","created_at":"2026-07-28T08:18:56.989Z","trace_propagation_headers":{"sentry-trace":"4101292b5ae444259c4c14323725c656-395f930e52b44c40","baggage":"sentry-trace_id=4101292b5ae444259c4c14323725c656,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWWCJGD508F89N2VSYQRW5","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:3a632123e127d48afd25738715c661884812a5934efac71dd77cc77811555017","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:19.765Z","retry_count":0,"job_size_bytes":451,"pid":2497,"sidekiq_tid":"m4ap","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-66bbdd5e3f53428b7d346075: fail: 0.076924 sec","job_status":"fail","queue_duration_s":0.448735,"scheduling_latency_s":0.448792,"redis_calls":7,"redis_duration_s":0.00243,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000702,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076924,"completed_at":"2026-07-28T08:19:20.290Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/w9mp1gyfs2qdv12r0ji70idzndmxwz2s-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/p8ylyr0sj9sxcknqcpja13nypqixk2dp-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/dndr7b4a17339dsm67vzb6nv4p2kp82q-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/zx6ndpscxs64hnidz69ab430ccms6rak-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.020001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2080gitlab # [ 399.850889] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:20.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"370c7f2d8a952304c26e6edc","created_at":"2026-07-28T08:19:17.379Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-133e9fd2c3bc4992","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:17.413Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-370c7f2d8a952304c26e6edc: start","job_status":"start","queue_duration_s":2.881237,"scheduling_latency_s":2.881279}2081gitlab # [ 399.870180] nixbot[4283]: INFO: ::ffff:127.0.0.1:35780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK2082gitlab # [ 399.872693] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1512083gitlab # [ 399.874854] gitlab-workhorse[1293]: time="2026-07-28T08:19:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672084gitlab # [ 399.876842] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 1062085gitlab # [ 399.878786] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 932086gitlab # [ 399.880989] gitlab-workhorse[1293]: time="2026-07-28T08:19:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212087gitlab # [ 399.882883] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.54.0" 1222088gitlab # [ 399.885427] gitaly[1368]: time="2026-07-28T08:19:20.349Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=12 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX406R5MFP3WD5WA8FTXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:20.314" grpc.time_ms=34.79 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc2089gitlab # [ 399.899046] gitaly[1368]: time="2026-07-28T08:19:20.457Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4507YX5GRGFED2NJMKY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:20.436" pid=1368 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc2090gitlab # [ 399.909721] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:20.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"370c7f2d8a952304c26e6edc","created_at":"2026-07-28T08:19:17.379Z","trace_propagation_headers":{"sentry-trace":"ef2b0d35f8194cde8c55b87fc6a64658-133e9fd2c3bc4992","baggage":"sentry-trace_id=ef2b0d35f8194cde8c55b87fc6a64658,sentry-release=Unknown"},"correlation_id":"01KYKWWKT4D02PJ9GB0WWDBPRY","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:17.413Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-370c7f2d8a952304c26e6edc: done: 0.135494 sec","job_status":"done","queue_duration_s":2.881237,"scheduling_latency_s":2.881279,"redis_calls":11,"redis_duration_s":0.007436,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000864,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005592,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0008673,"duration_s":0.135494,"completed_at":"2026-07-28T08:19:20.430Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2091gitlab # [ 399.956724] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:20.433Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a87de9cac6a0b0db2ee6f5fa","created_at":"2026-07-28T08:19:18.023Z","trace_propagation_headers":{"sentry-trace":"bb68a6db79a141e29bb1c5cd19a366ac-10bf57b37fcc4b4a","baggage":"sentry-trace_id=bb68a6db79a141e29bb1c5cd19a366ac,sentry-release=Unknown"},"correlation_id":"01KYKWWW11Q8Y687TZZN8C227Z","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:18.037Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a87de9cac6a0b0db2ee6f5fa: start","job_status":"start","queue_duration_s":2.395702,"scheduling_latency_s":2.395738}2092gitlab # [ 399.973408] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:20.511Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a87de9cac6a0b0db2ee6f5fa","created_at":"2026-07-28T08:19:18.023Z","trace_propagation_headers":{"sentry-trace":"bb68a6db79a141e29bb1c5cd19a366ac-10bf57b37fcc4b4a","baggage":"sentry-trace_id=bb68a6db79a141e29bb1c5cd19a366ac,sentry-release=Unknown"},"correlation_id":"01KYKWWW11Q8Y687TZZN8C227Z","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:18.037Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a87de9cac6a0b0db2ee6f5fa: done: 0.077839 sec","job_status":"done","queue_duration_s":2.395702,"scheduling_latency_s":2.395738,"redis_calls":10,"redis_duration_s":0.007608,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003355,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001135,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00210426,"duration_s":0.077839,"completed_at":"2026-07-28T08:19:20.511Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2093gitlab # [ 400.018600] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:20.513Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5bb1ee2931b22b5028394eff","created_at":"2026-07-28T08:19:18.473Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-a5be8a1b08c74335","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:18.483Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5bb1ee2931b22b5028394eff: start","job_status":"start","queue_duration_s":2.030469,"scheduling_latency_s":2.030507}2094gitlab # [ 400.035359] gitaly[1368]: time="2026-07-28T08:19:20.457Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=11 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4507YX5GRGFED2NJMKY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:20.436" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc2095gitlab # [ 400.050767] gitaly[1368]: time="2026-07-28T08:19:20.459Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=11 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4507YX5GRGFED2NJMKY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:20.436" grpc.time_ms=21.72 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc2096gitlab # [ 400.065901] gitaly[1368]: time="2026-07-28T08:19:20.593Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX49MYVBBM7DTH1XV2YW2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:20.580" grpc.time_ms=12.867 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc2097gitlab # [ 400.080045] gitaly[1368]: time="2026-07-28T08:19:20.721Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:20.720" grpc.time_ms=0.538 pid=1368 span.kind=server system=grpc2098gitlab # [ 400.089945] gitaly[1368]: time="2026-07-28T08:19:20.723Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4CTP737K09SX2KJ860M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:20.701" pid=1368 remote_ip="2001:db8:1::1" request_sha=f1e6bb59289c4d43fc3699ed3fc4760ee01ef0e9 response_bytes=221 span.kind=server system=grpc2099gitlab # [ 400.100528] gitaly[1368]: time="2026-07-28T08:19:20.723Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4CTP737K09SX2KJ860M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:20.701" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc2100gitlab # [ 400.114744] gitaly[1368]: time="2026-07-28T08:19:20.724Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4CTP737K09SX2KJ860M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-28T08:19:20.701" grpc.time_ms=22.687 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc2101gitlab # [ 400.130161] gitaly[1368]: time="2026-07-28T08:19:20.752Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:20.751" grpc.time_ms=0.487 pid=1368 span.kind=server system=grpc2102gitlab # [ 400.140078] gitaly[1368]: time="2026-07-28T08:19:20.782Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:20.781" grpc.time_ms=0.603 pid=1368 span.kind=server system=grpc2103gitlab # [ 400.150506] gitaly[1368]: time="2026-07-28T08:19:20.795Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 diskcache=14c17f4c-c339-4011-95a2-e963f8959cc6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-28T08:19:50.679" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:20.680" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 400.160701] gitaly[1368]: time="2026-07-28T08:19:20.795Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=98 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7155 command.oublock=0 command.real_time_ms=108 command.spawn_token_fork_ms=1 command.system_time_ms=37 command.user_time_ms=61 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-28T08:19:50.679" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:20.680" grpc.time_ms=114.948 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab # [ 400.174329] gitaly[1368]: time="2026-07-28T08:19:20.846Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:50.144" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:20.844" grpc.time_ms=1.795 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 400.187588] gitaly[1368]: time="2026-07-28T08:19:20.872Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-28T08:19:50.158" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:20.858" grpc.time_ms=13.436 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 400.202440] gitaly[1368]: time="2026-07-28T08:19:20.892Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:30.281" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:20.881" grpc.time_ms=10.294 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 400.216479] gitaly[1368]: time="2026-07-28T08:19:20.921Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-28T08:19:30.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:20.921" grpc.time_ms=0.374 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 400.227713] gitaly[1368]: time="2026-07-28T08:19:20.938Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-28T08:19:30.017" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:20.928" grpc.time_ms=10.09 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 400.242868] gitaly[1368]: time="2026-07-28T08:19:20.944Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-28T08:19:50.040" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:20.941" grpc.time_ms=2.836 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 400.256361] gitaly[1368]: time="2026-07-28T08:19:20.987Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:20.983" grpc.time_ms=2.796 pid=1368 span.kind=server system=grpc2112gitlab # [ 400.266814] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.105Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5bb1ee2931b22b5028394eff","created_at":"2026-07-28T08:19:18.473Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-a5be8a1b08c74335","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:18.483Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2497,"job_status":"rescheduled","message":"PipelineProcessWorker JID-5bb1ee2931b22b5028394eff: rescheduled"}2113gitlab # [ 400.282479] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.118Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5bb1ee2931b22b5028394eff","created_at":"2026-07-28T08:19:18.473Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-a5be8a1b08c74335","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:18.483Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5bb1ee2931b22b5028394eff: done: 0.60509 sec","job_status":"done","queue_duration_s":2.030469,"scheduling_latency_s":2.030507,"gitaly_calls":4,"gitaly_duration_s":0.133834,"redis_calls":109,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.03284,"redis_read_bytes":195,"redis_write_bytes":26557,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002131,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002128,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":26,"redis_feature_flag_duration_s":0.008736,"redis_feature_flag_read_bytes":26,"redis_feature_flag_write_bytes":4583,"redis_queues_calls":25,"redis_queues_duration_s":0.005823,"redis_queues_read_bytes":29,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":20,"redis_queues_metadata_duration_s":0.008098,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3301,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000737,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000536,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00252,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":851,"db_count":49,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":49,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.083,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.029,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.032,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.378412,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.55200006,"duration_s":0.60509,"completed_at":"2026-07-28T08:19:21.118Z","load_balancing_strategy":"primary","db_duration_s":0.091102,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2114gitlab # [ 400.337578] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.122Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","793514532ee75c643a79331c"],"class":"WebHooks::LogExecutionWorker","jid":"c25eb3b88f9c0ba8f9003ea6","created_at":"2026-07-28T08:19:20.165Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-2a0e987e75744144","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9a858ccf5003a64aa0897625171e94caf51a57ae03621aba14983c333735c036","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.184Z","job_size_bytes":2507,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c25eb3b88f9c0ba8f9003ea6: start","job_status":"start","queue_duration_s":0.938517,"scheduling_latency_s":0.938566}2115gitlab # [ 400.355075] gitaly[1368]: time="2026-07-28T08:19:20.999Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:50.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:20.998" grpc.time_ms=0.718 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 400.368077] gitaly[1368]: time="2026-07-28T08:19:21.015Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:21.014" grpc.time_ms=0.864 pid=1368 span.kind=server system=grpc2117gitlab # [ 400.377998] nixbot[4283]: {"ts": "2026-07-28T08:19:21.172Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/447dd2a526868fb2d085dd0d3dc9ba43c2227108 \"HTTP/1.1 201 Created\""}2118gitlab # [ 400.380896] nixbot[4283]: {"ts": "2026-07-28T08:19:21.185Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-447dd2a52686-d73ea28e"}2119gitlab # [ 400.383368] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4032120gitlab # [ 400.386142] gitaly[1368]: time="2026-07-28T08:19:21.024Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 diskcache=3a1b2d2f-baa1-4252-baea-05ba13dae06c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-28T08:19:30.011" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:20.942" pid=1368 ref=refs/keep-around/447dd2a526868fb2d085dd0d3dc9ba43c2227108 remote_ip="2001:db8:1::1" revision=447dd2a526868fb2d085dd0d3dc9ba43c2227108 span.kind=server system=grpc username=root2121gitlab # [ 400.398454] nix-daemon[4564]: accepted connection from pid 4786, user nixbot2122gitlab # [ 400.399462] gitaly[1368]: time="2026-07-28T08:19:21.024Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=71 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5281 command.oublock=8 command.real_time_ms=75 command.spawn_token_fork_ms=1 command.system_time_ms=50 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-28T08:19:30.011" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-28T08:19:20.942" grpc.time_ms=81.848 pid=1368 ref=refs/keep-around/447dd2a526868fb2d085dd0d3dc9ba43c2227108 remote_ip="2001:db8:1::1" revision=447dd2a526868fb2d085dd0d3dc9ba43c2227108 span.kind=server system=grpc username=root2123gitlab # [ 400.414936] gitaly[1368]: time="2026-07-28T08:19:21.030Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:51.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:21.029" grpc.time_ms=0.474 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108'2125gitlab # [ 400.428265] gitaly[1368]: time="2026-07-28T08:19:21.091Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX1TZZV970MEJZ0NQNKJ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:51.089" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:21.090" grpc.time_ms=0.909 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108', in 0.08 seconds)2127(finished: subtest: push delivers the webhook, in 12.30 seconds)2128subtest: eval and build post commit statuses2129gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses2130gitlab # [ 400.492315] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.369Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","793514532ee75c643a79331c"],"class":"WebHooks::LogExecutionWorker","jid":"c25eb3b88f9c0ba8f9003ea6","created_at":"2026-07-28T08:19:20.165Z","trace_propagation_headers":{"sentry-trace":"2d6c39fa21a14b1c92d1606086400db5-2a0e987e75744144","baggage":"sentry-trace_id=2d6c39fa21a14b1c92d1606086400db5,sentry-release=Unknown"},"correlation_id":"01KYKWWSYMAG9QSPH1A1FDK1N3","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9a858ccf5003a64aa0897625171e94caf51a57ae03621aba14983c333735c036","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.184Z","job_size_bytes":2507,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c25eb3b88f9c0ba8f9003ea6: done: 0.24687 sec","job_status":"done","queue_duration_s":0.938517,"scheduling_latency_s":0.938566,"redis_calls":10,"redis_duration_s":0.0038209999999999997,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000838,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.064,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.064,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.213288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072164,"duration_s":0.24687,"completed_at":"2026-07-28T08:19:21.369Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024742,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2131gitlab # [ 400.542285] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.371Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"23b9cc62098517f67875ea68","created_at":"2026-07-28T08:19:20.649Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.659Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-23b9cc62098517f67875ea68: start","job_status":"start","queue_duration_s":0.712606,"scheduling_latency_s":0.712646}2132gitlab # [ 400.559956] nixbot[4283]: INFO: ::ffff:127.0.0.1:35796 - "GET /api/repos/gitlab/root/test-flake/builds?commit=447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 200 OK2133gitlab # [ 400.562187] nixbot[4283]: {"ts": "2026-07-28T08:19:21.420Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-447dd2a52686-d73ea28e", "argv0": "bwrap"}2134gitlab # [ 400.564763] nix-daemon[4564]: accepted connection from pid 4794, user nixbot2135gitlab # [ 400.677898] nix-daemon[4564]: accepted connection from pid 4819, user nixbot2136gitlab # [ 400.687270] gitaly[1368]: time="2026-07-28T08:19:21.562Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX573QA99JCY69TWQZG0D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:51.559" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:21.560" grpc.time_ms=0.868 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 400.705142] nix-daemon[4564]: accepted connection from pid 4821, user nixbot2138gitlab # [ 400.747696] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1812139gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses, in 0.24 seconds)2140gitlab # [ 400.802714] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.679Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"23b9cc62098517f67875ea68","created_at":"2026-07-28T08:19:20.649Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.659Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-23b9cc62098517f67875ea68: done: 0.308014 sec","job_status":"done","queue_duration_s":0.712606,"scheduling_latency_s":0.712646,"redis_calls":10,"redis_duration_s":0.0036290000000000003,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000631,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000822,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.270795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070816,"duration_s":0.308014,"completed_at":"2026-07-28T08:19:21.679Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020131,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2141gitlab # [ 400.882901] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.682Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ba556c0d88bbc6ce33c06cbe","created_at":"2026-07-28T08:19:20.803Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.812Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ba556c0d88bbc6ce33c06cbe: start","job_status":"start","queue_duration_s":0.869926,"scheduling_latency_s":0.869964}2142gitlab # [ 400.904042] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.736Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ba556c0d88bbc6ce33c06cbe","created_at":"2026-07-28T08:19:20.803Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.812Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ba556c0d88bbc6ce33c06cbe: done: 0.054128 sec","job_status":"done","queue_duration_s":0.869926,"scheduling_latency_s":0.869964,"redis_calls":10,"redis_duration_s":0.004148,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000842,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065832,"duration_s":0.054128,"completed_at":"2026-07-28T08:19:21.736Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2143gitlab # [ 400.954870] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.739Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"024792bef801e27b6ecc14cc","created_at":"2026-07-28T08:19:20.830Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.846Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-024792bef801e27b6ecc14cc: start","job_status":"start","queue_duration_s":0.892617,"scheduling_latency_s":0.89265}2144gitlab # [ 400.971372] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.808Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"024792bef801e27b6ecc14cc","created_at":"2026-07-28T08:19:20.830Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.846Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-024792bef801e27b6ecc14cc: done: 0.069402 sec","job_status":"done","queue_duration_s":0.892617,"scheduling_latency_s":0.89265,"redis_calls":10,"redis_duration_s":0.004182,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00084,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002464,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065234,"duration_s":0.069402,"completed_at":"2026-07-28T08:19:21.808Z","load_balancing_strategy":"primary","db_duration_s":0.017003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2145gitlab # [ 401.016206] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.811Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"73ab1ceaa850390033b512dd","created_at":"2026-07-28T08:19:20.870Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.880Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-73ab1ceaa850390033b512dd: start","job_status":"start","queue_duration_s":0.93139,"scheduling_latency_s":0.931423}2146gitlab # [ 401.032154] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.868Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"73ab1ceaa850390033b512dd","created_at":"2026-07-28T08:19:20.870Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.880Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-73ab1ceaa850390033b512dd: done: 0.056948 sec","job_status":"done","queue_duration_s":0.93139,"scheduling_latency_s":0.931423,"redis_calls":13,"redis_duration_s":0.0049,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000872,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001198,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000703,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047358,"duration_s":0.056948,"completed_at":"2026-07-28T08:19:21.868Z","load_balancing_strategy":"primary","db_duration_s":0.009808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2147gitlab # [ 401.078600] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.872Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a286c22450f7e44228bef38f","created_at":"2026-07-28T08:19:20.881Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.891Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a286c22450f7e44228bef38f: start","job_status":"start","queue_duration_s":0.98075,"scheduling_latency_s":0.980784}2148gitlab # [ 401.097129] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.926Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a286c22450f7e44228bef38f","created_at":"2026-07-28T08:19:20.881Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.891Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a286c22450f7e44228bef38f: done: 0.054009 sec","job_status":"done","queue_duration_s":0.98075,"scheduling_latency_s":0.980784,"redis_calls":10,"redis_duration_s":0.004085,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000832,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002475,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000778,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070238,"duration_s":0.054009,"completed_at":"2026-07-28T08:19:21.926Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2149gitlab # [ 401.142991] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.929Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fbc0c4f981fb39fa086d8fc7","created_at":"2026-07-28T08:19:20.893Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.905Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fbc0c4f981fb39fa086d8fc7: start","job_status":"start","queue_duration_s":1.023437,"scheduling_latency_s":1.023475}2150gitlab # [ 401.159848] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.985Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fbc0c4f981fb39fa086d8fc7","created_at":"2026-07-28T08:19:20.893Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.905Z","job_size_bytes":19,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fbc0c4f981fb39fa086d8fc7: done: 0.05582 sec","job_status":"done","queue_duration_s":1.023437,"scheduling_latency_s":1.023475,"redis_calls":11,"redis_duration_s":0.004373,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000886,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0027,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000787,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044924,"duration_s":0.05582,"completed_at":"2026-07-28T08:19:21.984Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009531,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2151gitlab # [ 401.205763] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:21.987Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fcb8deddd3cc2816dbd5544c","created_at":"2026-07-28T08:19:20.910Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.920Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fcb8deddd3cc2816dbd5544c: start","job_status":"start","queue_duration_s":1.066861,"scheduling_latency_s":1.066893}2152gitlab # [ 401.223892] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.039Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"fcb8deddd3cc2816dbd5544c","created_at":"2026-07-28T08:19:20.910Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.920Z","job_size_bytes":66,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-fcb8deddd3cc2816dbd5544c: done: 0.051275 sec","job_status":"done","queue_duration_s":1.066861,"scheduling_latency_s":1.066893,"redis_calls":10,"redis_duration_s":0.0031249999999999997,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000521,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000672,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047016,"duration_s":0.051275,"completed_at":"2026-07-28T08:19:22.038Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007862,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2153gitlab # [ 401.271294] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.041Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5d0d0baa757f0986fb077169","created_at":"2026-07-28T08:19:20.923Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.927Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5d0d0baa757f0986fb077169: start","job_status":"start","queue_duration_s":1.114393,"scheduling_latency_s":1.114428}2154gitlab # [ 401.288196] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.093Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5d0d0baa757f0986fb077169","created_at":"2026-07-28T08:19:20.923Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:20.927Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5d0d0baa757f0986fb077169: done: 0.052183 sec","job_status":"done","queue_duration_s":1.114393,"scheduling_latency_s":1.114428,"redis_calls":7,"redis_duration_s":0.002844,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000769,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052183,"completed_at":"2026-07-28T08:19:22.093Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2155gitlab # [ 401.332833] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.096Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a613146cb99becb6968dfa55","created_at":"2026-07-28T08:19:21.011Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.020Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a613146cb99becb6968dfa55: start","job_status":"start","queue_duration_s":1.075274,"scheduling_latency_s":1.075309}2156gitlab # [ 401.349611] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.162Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a613146cb99becb6968dfa55","created_at":"2026-07-28T08:19:21.011Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.020Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a613146cb99becb6968dfa55: done: 0.066094 sec","job_status":"done","queue_duration_s":1.075274,"scheduling_latency_s":1.075309,"redis_calls":10,"redis_duration_s":0.0037479999999999996,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000672,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002204,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063954,"duration_s":0.066094,"completed_at":"2026-07-28T08:19:22.162Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab # [ 401.395090] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.165Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"26c20d87974467684a048202","created_at":"2026-07-28T08:19:21.021Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.030Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-26c20d87974467684a048202: start","job_status":"start","queue_duration_s":1.134143,"scheduling_latency_s":1.134177}2158gitlab # [ 401.411542] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.205Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"26c20d87974467684a048202","created_at":"2026-07-28T08:19:21.021Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.030Z","job_size_bytes":6,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-26c20d87974467684a048202: done: 0.040446 sec","job_status":"done","queue_duration_s":1.134143,"scheduling_latency_s":1.134177,"redis_calls":10,"redis_duration_s":0.004116,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000843,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002254,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006352,"duration_s":0.040446,"completed_at":"2026-07-28T08:19:22.205Z","load_balancing_strategy":"primary","db_duration_s":0.0054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2159gitlab # [ 401.456681] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.208Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"32199ae0e8fb234ba305fc20","created_at":"2026-07-28T08:19:21.032Z","trace_propagation_headers":{"sentry-trace":"287b3472ef1f4715af1b04efa869e65d-07da94b81c824708","baggage":"sentry-trace_id=287b3472ef1f4715af1b04efa869e65d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWX4HZPH59RGC6YFM7TXV3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.037Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-32199ae0e8fb234ba305fc20: start","job_status":"start","queue_duration_s":1.170832,"scheduling_latency_s":1.170866}2160gitlab # [ 401.473849] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.255Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"32199ae0e8fb234ba305fc20","created_at":"2026-07-28T08:19:21.032Z","trace_propagation_headers":{"sentry-trace":"287b3472ef1f4715af1b04efa869e65d-07da94b81c824708","baggage":"sentry-trace_id=287b3472ef1f4715af1b04efa869e65d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWX4HZPH59RGC6YFM7TXV3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.037Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-32199ae0e8fb234ba305fc20: done: 0.047765 sec","job_status":"done","queue_duration_s":1.170832,"scheduling_latency_s":1.170866,"redis_calls":7,"redis_duration_s":0.002925,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047765,"completed_at":"2026-07-28T08:19:22.255Z","load_balancing_strategy":"primary","db_duration_s":0.007081,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2161gitlab # [ 401.519179] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.258Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"c57a8702d291023d923ea705","created_at":"2026-07-28T08:19:21.032Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.040Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-c57a8702d291023d923ea705: start","job_status":"start","queue_duration_s":1.217992,"scheduling_latency_s":1.218029}2162gitlab # [ 401.534994] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.317Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"c57a8702d291023d923ea705","created_at":"2026-07-28T08:19:21.032Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.040Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-c57a8702d291023d923ea705: done: 0.05877 sec","job_status":"done","queue_duration_s":1.217992,"scheduling_latency_s":1.218029,"redis_calls":10,"redis_duration_s":0.004083,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000659,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002388,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064024,"duration_s":0.05877,"completed_at":"2026-07-28T08:19:22.317Z","load_balancing_strategy":"primary","db_duration_s":0.01251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2163gitlab # [ 401.579686] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.319Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a542e544a620b5af082558a3","created_at":"2026-07-28T08:19:21.038Z","trace_propagation_headers":{"sentry-trace":"287b3472ef1f4715af1b04efa869e65d-07da94b81c824708","baggage":"sentry-trace_id=287b3472ef1f4715af1b04efa869e65d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWX4HZPH59RGC6YFM7TXV3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.042Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a542e544a620b5af082558a3: start","job_status":"start","queue_duration_s":1.277736,"scheduling_latency_s":1.277771}2164gitlab # [ 401.598189] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.457Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a542e544a620b5af082558a3","created_at":"2026-07-28T08:19:21.038Z","trace_propagation_headers":{"sentry-trace":"287b3472ef1f4715af1b04efa869e65d-07da94b81c824708","baggage":"sentry-trace_id=287b3472ef1f4715af1b04efa869e65d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWX4HZPH59RGC6YFM7TXV3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.042Z","job_size_bytes":65,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a542e544a620b5af082558a3: done: 0.138009 sec","job_status":"done","queue_duration_s":1.277736,"scheduling_latency_s":1.277771,"redis_calls":10,"redis_duration_s":0.007893,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005022,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002871,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.087777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.138009,"completed_at":"2026-07-28T08:19:22.457Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 401.643401] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.464Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"c48a7e1383228db185e5e0c0","created_at":"2026-07-28T08:19:21.106Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.109Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c48a7e1383228db185e5e0c0: start","job_status":"start","queue_duration_s":1.355101,"scheduling_latency_s":1.35518}2166gitlab # [ 401.659322] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.520Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"c48a7e1383228db185e5e0c0","created_at":"2026-07-28T08:19:21.106Z","trace_propagation_headers":{"sentry-trace":"894c89ed83d7482793f1f161092f07f9-8f18d8c19e3c4389","baggage":"sentry-trace_id=894c89ed83d7482793f1f161092f07f9,sentry-release=Unknown"},"correlation_id":"01KYKWX1TZZV970MEJZ0NQNKJ4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.109Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c48a7e1383228db185e5e0c0: done: 0.055853 sec","job_status":"done","queue_duration_s":1.355101,"scheduling_latency_s":1.35518,"redis_calls":8,"redis_duration_s":0.0042970000000000005,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003334,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055853,"completed_at":"2026-07-28T08:19:22.520Z","load_balancing_strategy":"primary","db_duration_s":0.004851,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2167gitlab # [ 401.702648] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:22.523Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7f8e9261c678e4d70f962e89","created_at":"2026-07-28T08:19:21.136Z","trace_propagation_headers":{"sentry-trace":"287b3472ef1f4715af1b04efa869e65d-07da94b81c824708","baggage":"sentry-trace_id=287b3472ef1f4715af1b04efa869e65d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWX4HZPH59RGC6YFM7TXV3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.142Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7f8e9261c678e4d70f962e89: start","job_status":"start","queue_duration_s":1.381554,"scheduling_latency_s":1.381604}2168gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses2169gitlab # [ 401.811302] gitaly[1368]: time="2026-07-28T08:19:22.688Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-28T08:19:52.685" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:22.686" grpc.time_ms=1.481 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab # [ 401.953498] gitaly[1368]: time="2026-07-28T08:19:22.830Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX6F16AXMZS49AJ2TQYD4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:52.728" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:22.829" grpc.time_ms=1.36 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses, in 0.27 seconds)2172gitlab # [ 402.022694] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1772173gitlab # [ 402.154859] gitaly[1368]: time="2026-07-28T08:19:23.032Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:53.030" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:23.031" grpc.time_ms=1.25 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2174gitlab # [ 402.244948] gitaly[1368]: time="2026-07-28T08:19:23.122Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX4HZPH59RGC6YFM7TXV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:53.120" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:23.120" grpc.time_ms=1.463 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 402.275131] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:23.151Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"7f8e9261c678e4d70f962e89","created_at":"2026-07-28T08:19:21.136Z","trace_propagation_headers":{"sentry-trace":"287b3472ef1f4715af1b04efa869e65d-07da94b81c824708","baggage":"sentry-trace_id=287b3472ef1f4715af1b04efa869e65d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWX4HZPH59RGC6YFM7TXV3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:21.142Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7f8e9261c678e4d70f962e89: done: 0.627377 sec","job_status":"done","queue_duration_s":1.381554,"scheduling_latency_s":1.381604,"gitaly_calls":3,"gitaly_duration_s":0.018999,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.019447,"redis_read_bytes":98,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002544,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.005203,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000642,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003432,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000516,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001293,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.308,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.282,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.307399,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.56922466,"duration_s":0.627377,"completed_at":"2026-07-28T08:19:23.151Z","load_balancing_strategy":"primary","db_duration_s":0.31199,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2176gitlab # [ 402.339743] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:23.154Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d20bd20d76d33b4bc9745437","created_at":"2026-07-28T08:19:22.647Z","trace_propagation_headers":{"sentry-trace":"287b3472ef1f4715af1b04efa869e65d-751d618eb4a84ba5","baggage":"sentry-trace_id=287b3472ef1f4715af1b04efa869e65d,sentry-release=Unknown"},"correlation_id":"01KYKWX4HZPH59RGC6YFM7TXV3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:22.653Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d20bd20d76d33b4bc9745437: start","job_status":"start","queue_duration_s":0.500989,"scheduling_latency_s":0.501038}2177gitlab # [ 402.359004] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:23.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d20bd20d76d33b4bc9745437","created_at":"2026-07-28T08:19:22.647Z","trace_propagation_headers":{"sentry-trace":"287b3472ef1f4715af1b04efa869e65d-751d618eb4a84ba5","baggage":"sentry-trace_id=287b3472ef1f4715af1b04efa869e65d,sentry-release=Unknown"},"correlation_id":"01KYKWX4HZPH59RGC6YFM7TXV3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:22.653Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d20bd20d76d33b4bc9745437: done: 0.066732 sec","job_status":"done","queue_duration_s":0.500989,"scheduling_latency_s":0.501038,"redis_calls":7,"redis_duration_s":0.003221,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002276,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066732,"completed_at":"2026-07-28T08:19:23.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2178gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses2179gitlab # [ 403.192464] gitaly[1368]: time="2026-07-28T08:19:24.069Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX7NZJD6B331KR8VRA43K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:54.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:24.067" grpc.time_ms=1.303 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses, in 0.23 seconds)2181gitlab # [ 403.254846] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1632182gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses2183gitlab # [ 404.439243] gitaly[1368]: time="2026-07-28T08:19:25.316Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWX8WAA12AE2CA4H7VY2JC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:55.313" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:25.314" grpc.time_ms=1.285 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses, in 0.25 seconds)2185gitlab # [ 404.504922] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1862186gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses2187gitlab # [ 405.686390] gitaly[1368]: time="2026-07-28T08:19:26.562Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWXA3CQGMN1HYYSQFYCZVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:56.560" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:26.561" grpc.time_ms=1.46 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 405.741707] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1732189gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses, in 0.24 seconds)2190gitlab # [ 405.981844] gitaly[1368]: time="2026-07-28T08:19:26.859Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:56.856" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:26.857" grpc.time_ms=1.505 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191gitlab # [ 406.078148] gitaly[1368]: time="2026-07-28T08:19:26.955Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:36.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:26.935" grpc.time_ms=20.248 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab # [ 406.164179] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:27.039Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e8412df603f5009e1be3a075","created_at":"2026-07-28T08:19:27.029Z","trace_propagation_headers":{"sentry-trace":"bae372c5de044f469b1eae2501646bb5-bc4d644a0d2b42e0","baggage":"sentry-trace_id=bae372c5de044f469b1eae2501646bb5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWXAC7DYGTR407H3ZHPVNX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:27.036Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e8412df603f5009e1be3a075: start","job_status":"start","queue_duration_s":0.00308,"scheduling_latency_s":0.003149}2193gitlab # [ 406.210419] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3402194gitlab # [ 406.217290] nixbot[4283]: {"ts": "2026-07-28T08:19:27.070Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/447dd2a526868fb2d085dd0d3dc9ba43c2227108 \"HTTP/1.1 201 Created\""}2195gitlab # [ 406.309805] gitaly[1368]: time="2026-07-28T08:19:27.187Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWXAQ46MSDVX97KHGV17Z0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:57.184" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:27.185" grpc.time_ms=1.508 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 406.408117] gitaly[1368]: time="2026-07-28T08:19:27.285Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01KYKWXAQ46MSDVX97KHGV17Z0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:37.068" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:27.268" grpc.time_ms=16.757 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 406.457950] gitaly[1368]: time="2026-07-28T08:19:27.335Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:27.333" grpc.time_ms=1.063 pid=1368 span.kind=server system=grpc2198gitlab # [ 406.506457] gitaly[1368]: time="2026-07-28T08:19:27.384Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:27.383" grpc.time_ms=0.66 pid=1368 span.kind=server system=grpc2199gitlab # [ 406.534090] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3122200gitlab # [ 406.540198] nixbot[4283]: {"ts": "2026-07-28T08:19:27.395Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/447dd2a526868fb2d085dd0d3dc9ba43c2227108 \"HTTP/1.1 201 Created\""}2201gitlab # [ 406.564704] gitaly[1368]: time="2026-07-28T08:19:27.442Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-28T08:19:27.440" grpc.time_ms=1.661 pid=1368 span.kind=server system=grpc2202gitlab # [ 406.589668] gitaly[1368]: time="2026-07-28T08:19:27.458Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX diskcache=b6fda58e-3699-422e-b6c7-ca609459c2dd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-28T08:19:57.264" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:27.265" pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2203gitlab # [ 406.609699] gitaly[1368]: time="2026-07-28T08:19:27.458Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=189 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7408 command.oublock=0 command.real_time_ms=184 command.spawn_token_fork_ms=1 command.system_time_ms=104 command.user_time_ms=85 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-28T08:19:57.264" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:27.265" grpc.time_ms=193.183 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 406.667022] gitaly[1368]: time="2026-07-28T08:19:27.544Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWXB21V152NK4KS26VT1KZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:57.542" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:27.543" grpc.time_ms=1.216 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2205gitlab # [ 406.709848] gitaly[1368]: time="2026-07-28T08:19:27.586Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-28T08:19:57.584" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:27.584" grpc.time_ms=1.535 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses2207gitlab # [ 406.777599] gitaly[1368]: time="2026-07-28T08:19:27.655Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KYKWXB21V152NK4KS26VT1KZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-28T08:19:37.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-28T08:19:27.637" grpc.time_ms=17.617 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208gitlab # [ 406.810233] gitaly[1368]: time="2026-07-28T08:19:27.666Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:57.664" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:27.665" grpc.time_ms=1.139 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2209gitlab # [ 406.895655] gitaly[1368]: time="2026-07-28T08:19:27.772Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWXAC7DYGTR407H3ZHPVNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:57.769" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:27.770" grpc.time_ms=1.841 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2210gitlab # [ 406.913915] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/447dd2a526868fb2d085dd0d3dc9ba43c2227108 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3472211gitlab # [ 406.917418] nixbot[4283]: {"ts": "2026-07-28T08:19:27.776Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/447dd2a526868fb2d085dd0d3dc9ba43c2227108 \"HTTP/1.1 201 Created\""}2212gitlab # [ 406.920962] gitaly[1368]: time="2026-07-28T08:19:27.783Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYKWXBA8QG2GX5ACF4482WK2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-28T08:19:57.780" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-28T08:19:27.780" grpc.time_ms=2.705 pid=1368 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 406.935678] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:27.800Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5cb462130d1a7fd38c44f547","created_at":"2026-07-28T08:19:27.795Z","trace_propagation_headers":{"sentry-trace":"bae372c5de044f469b1eae2501646bb5-b329fcbbb04642a4","baggage":"sentry-trace_id=bae372c5de044f469b1eae2501646bb5,sentry-release=Unknown"},"correlation_id":"01KYKWXAC7DYGTR407H3ZHPVNX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"e8412df603f5009e1be3a075","job_size_bytes":3,"pid":2497,"job_status":"deduplicated","message":"PipelineProcessWorker JID-5cb462130d1a7fd38c44f547: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2214gitlab # [ 406.952838] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:27.804Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e8412df603f5009e1be3a075","created_at":"2026-07-28T08:19:27.029Z","trace_propagation_headers":{"sentry-trace":"bae372c5de044f469b1eae2501646bb5-bc4d644a0d2b42e0","baggage":"sentry-trace_id=bae372c5de044f469b1eae2501646bb5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWXAC7DYGTR407H3ZHPVNX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:27.036Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2497,"job_status":"rescheduled","message":"PipelineProcessWorker JID-e8412df603f5009e1be3a075: rescheduled"}2215gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses, in 0.25 seconds)2216(finished: subtest: eval and build post commit statuses, in 6.48 seconds)2217(finished: run the VM test script, in 476.95 seconds)2218gitlab # [ 406.968859] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:27.820Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e8412df603f5009e1be3a075","created_at":"2026-07-28T08:19:27.029Z","trace_propagation_headers":{"sentry-trace":"bae372c5de044f469b1eae2501646bb5-bc4d644a0d2b42e0","baggage":"sentry-trace_id=bae372c5de044f469b1eae2501646bb5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYKWXAC7DYGTR407H3ZHPVNX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:27.036Z","job_size_bytes":3,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e8412df603f5009e1be3a075: done: 0.780924 sec","job_status":"done","queue_duration_s":0.00308,"scheduling_latency_s":0.003149,"gitaly_calls":4,"gitaly_duration_s":0.223102,"redis_calls":89,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.049647,"redis_read_bytes":258,"redis_write_bytes":22668,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.003078,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.004901,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_queues_calls":25,"redis_queues_duration_s":0.008508,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14461,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.021865,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000802,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002783,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.004632,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":36,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.102,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":21,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.025,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.06,"db_ci_duration_s":0.042,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.433885,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6888437,"duration_s":0.780924,"completed_at":"2026-07-28T08:19:27.820Z","load_balancing_strategy":"primary","db_duration_s":0.107852,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2219gitlab # [ 407.024099] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:27.823Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"288b452a0d411224818c5291","created_at":"2026-07-28T08:19:27.243Z","trace_propagation_headers":{"sentry-trace":"bae372c5de044f469b1eae2501646bb5-b329fcbbb04642a4","baggage":"sentry-trace_id=bae372c5de044f469b1eae2501646bb5,sentry-release=Unknown"},"correlation_id":"01KYKWXAC7DYGTR407H3ZHPVNX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:27.249Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-288b452a0d411224818c5291: start","job_status":"start","queue_duration_s":0.574359,"scheduling_latency_s":0.574401}2220gitlab # [ 407.041159] gitlab-workhorse[1293]: gitlab 2001:db8:1::1 - - [2026/07/28:08:19:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/447dd2a526868fb2d085dd0d3dc9ba43c2227108/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 1532221gitlab # [ 407.048979] nix-daemon[4564]: accepted connection from pid 4900, user nixbot2222test script finished in 477.05s2223cleanup2224gitlab # [ 407.050154] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:27.903Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"288b452a0d411224818c5291","created_at":"2026-07-28T08:19:27.243Z","trace_propagation_headers":{"sentry-trace":"bae372c5de044f469b1eae2501646bb5-b329fcbbb04642a4","baggage":"sentry-trace_id=bae372c5de044f469b1eae2501646bb5,sentry-release=Unknown"},"correlation_id":"01KYKWXAC7DYGTR407H3ZHPVNX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-28T08:19:27.249Z","job_size_bytes":23,"pid":2497,"sidekiq_tid":"ma95","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-288b452a0d411224818c5291: done: 0.079439 sec","job_status":"done","queue_duration_s":0.574359,"scheduling_latency_s":0.574401,"redis_calls":7,"redis_duration_s":0.002676,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000816,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079439,"completed_at":"2026-07-28T08:19:27.902Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013238,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2225kill QemuMachine (pid 13)2226gitlab # [ 407.097718] sidekiq-cluster[2497]: {"severity":"INFO","time":"2026-07-28T08:19:27.906Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ca533b97e7656fe30b048472",qemu-system-aarch64: terminating on signal 15 from pid 6 (/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.13/bin/python3.13)2227gitlab # "2228(finished: cleanup, in 2.00 seconds)2229additionally exposed symbols:2230 gitlab,2231 vlan1,2232 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2233[]2234[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-07-28T08:19:08.810Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2235[]2236[]2237[]2238[]2239[]2240[]2241[]2242[]2243[]2244[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '447dd2a526868fb2d085dd0d3dc9ba43c2227108', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-07-28T08:19:20.757413Z', 'started_at': '2026-07-28T08:19:21.177152Z', 'finished_at': None}]2245[{'id': 3, 'sha': '447dd2a526868fb2d085dd0d3dc9ba43c2227108', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-28T08:19:21.121Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2246[{'id': 3, 'sha': '447dd2a526868fb2d085dd0d3dc9ba43c2227108', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-28T08:19:21.121Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2247[{'id': 3, 'sha': '447dd2a526868fb2d085dd0d3dc9ba43c2227108', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-28T08:19:21.121Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2248[{'id': 3, 'sha': '447dd2a526868fb2d085dd0d3dc9ba43c2227108', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-28T08:19:21.121Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2249[{'id': 3, 'sha': '447dd2a526868fb2d085dd0d3dc9ba43c2227108', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-07-28T08:19:21.121Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2250[{'id': 3, 'sha': '447dd2a526868fb2d085dd0d3dc9ba43c2227108', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-07-28T08:19:21.121Z', 'started_at': None, 'finished_at': '2026-07-28T08:19:27.006Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': '447dd2a526868fb2d085dd0d3dc9ba43c2227108', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-07-28T08:19:27.339Z', 'started_at': None, 'finished_at': '2026-07-28T08:19:27.718Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]