vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #315
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10(finished: start all VMs, in 111.25 seconds)11gitlab: waiting for unit setup-gitlab.service12gitlab: waiting for the VM to finish booting13gitlab # Disk image does not exist, creating the virtualisation disk image...14gitlab # Formatting '/build/vm-state-gitlab/tmp.B3ymAWc9eZ', fmt=raw size=107374182415gitlab # mke2fs 1.47.4 (6-Mar-2025)16gitlab # Discarding device blocks: 0/262144 done17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: bedf2449-9d00-4345-9770-20337a7ca70719gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/smnpmdfnnaian54wpragz0ra1sdavzj3-nixos-system-gitlab-test/init regInfo=/nix/store/y6yrsd3vqfvfim8y3k84518hnmkdplhy-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/y6yrsd3vqfvfim8y3k84518hnmkdplhy-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000037] arm-pv: using stolen time PV108gitlab # [ 0.000503] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000760] Console: colour dummy device 80x25110gitlab # [ 0.000769] printk: legacy console [tty0] enabled111gitlab # [ 0.000973] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000980] pid_max: default: 32768 minimum: 301113gitlab # [ 0.001071] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001217] landlock: Up and running.115gitlab # [ 0.001220] Yama: becoming mindful.116gitlab # [ 0.001731] LSM support for eBPF active117gitlab # [ 0.002025] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.002149] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003517] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.004364] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.004369] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.004591] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.005823] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.005924] EFI services will not be available.125gitlab # [ 0.006142] smp: Bringing up secondary CPUs ...126gitlab # [ 0.006863] Detected PIPT I-cache on CPU1127gitlab # [ 0.006926] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.006977] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.007036] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.011127] Detected PIPT I-cache on CPU2131gitlab # [ 0.011210] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.011263] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.011326] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.012630] Detected PIPT I-cache on CPU3135gitlab # [ 0.012718] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.012770] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.012840] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.013665] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.013707] SMP: Total of 4 processors activated.140gitlab # [ 0.013710] CPU: All CPU(s) started at EL1141gitlab # [ 0.013721] CPU features: detected: Branch Target Identification142gitlab # [ 0.013726] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.013729] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.013780] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.013783] CPU features: detected: Common not Private translations146gitlab # [ 0.013786] CPU features: detected: CRC32 instructions147gitlab # [ 0.013789] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.013792] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.013795] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.013798] CPU features: detected: E0PD151gitlab # [ 0.013800] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.013803] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.013806] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.013809] CPU features: detected: Fine Grained Traps155gitlab # [ 0.013812] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.013816] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.013819] CPU features: detected: LSE atomic instructions158gitlab # [ 0.013821] CPU features: detected: Privileged Access Never159gitlab # [ 0.013824] CPU features: detected: PMUv3160gitlab # [ 0.013826] CPU features: detected: RAS Extension Support161gitlab # [ 0.013829] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.013831] CPU features: detected: Random Number Generator163gitlab # [ 0.013834] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.013836] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.013839] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.013843] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.014071] alternatives: applying system-wide alternatives168gitlab # [ 0.017933] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.018347] Memory: 5963768K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.021227] devtmpfs: initialized171gitlab # [ 0.026361] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.026509] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.026814] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.026820] 0 pages in range for non-PLT usage175gitlab # [ 0.026822] 508288 pages in range for PLT usage176gitlab # [ 0.027057] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.028116] DMI not present or invalid.178gitlab # [ 0.033197] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.037007] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.037510] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.040853] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.040924] audit: initializing netlink subsys (disabled)183gitlab # [ 0.041793] audit: type=2000 audit(0.036:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.042387] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.042394] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.042399] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.042402] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.042405] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.042605] cpuidle: using governor ladder190gitlab # [ 0.042679] cpuidle: using governor menu191gitlab # [ 0.043037] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.043845] ASID allocator initialised with 65536 entries193gitlab # [ 0.045231] Serial: AMBA PL011 UART driver194gitlab # [ 0.051095] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.051643] printk: console [ttyAMA0] enabled196gitlab # [ 0.058345] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.058364] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.058368] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.058371] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.058373] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.058376] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.058379] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.058382] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.068311] fbcon: Taking over console205gitlab # [ 0.068339] ACPI: Interpreter disabled.206gitlab # [ 0.069801] iommu: Default domain type: Translated207gitlab # [ 0.069815] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.078360] SCSI subsystem initialized209gitlab # [ 0.079685] usbcore: registered new interface driver usbfs210gitlab # [ 0.079721] usbcore: registered new interface driver hub211gitlab # [ 0.079748] usbcore: registered new device driver usb212gitlab # [ 0.080254] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.080258] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.080269] PTP clock support registered215gitlab # [ 0.080327] EDAC MC: Ver: 3.0.0216gitlab # [ 0.081433] scmi_core: SCMI protocol bus registered217gitlab # [ 0.082653] FPGA manager framework218gitlab # [ 0.084084] vgaarb: loaded219gitlab # [ 0.097833] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.098566] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.098601] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.101999] netfs: FS-Cache loaded223gitlab # [ 0.102251] pnp: PnP ACPI: disabled224gitlab # [ 0.113101] NET: Registered PF_INET protocol family225gitlab # [ 0.114969] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.157725] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.158132] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.158227] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.158617] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.159185] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.159351] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.159438] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.159570] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.159807] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.159839] NET: Registered PF_XDP protocol family236gitlab # [ 0.159859] PCI: CLS 0 bytes, default 64237gitlab # [ 0.160191] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.177862] kvm [1]: HYP mode not available239gitlab # [ 0.283292] Initialise system trusted keyrings240gitlab # [ 0.290113] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.291517] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.291743] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.308064] Key type asymmetric registered244gitlab # [ 0.308095] Asymmetric key parser 'x509' registered245gitlab # [ 0.308262] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.314072] io scheduler mq-deadline registered247gitlab # [ 0.314109] io scheduler kyber registered248gitlab # [ 0.328583] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.338492] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.340286] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.341446] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.342319] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.342326] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.342379] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.342415] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.342569] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.342577] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.342596] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.342600] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.342603] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.342981] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.343501] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.344915] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.344935] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.344962] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.344975] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.345498] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.346744] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.346760] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.346787] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.348622] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.348806] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.348819] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.348847] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.349324] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.351160] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.351176] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.351203] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.351715] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.355902] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.355922] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.355950] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.356490] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.356678] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.356693] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.356719] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.362569] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.363898] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.364120] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.364159] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.364174] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.371522] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.371760] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.371795] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.372450] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.372683] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.372752] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.374595] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.374799] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.375076] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.382259] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.382293] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.382321] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.382901] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.383094] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.383107] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.383134] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.383783] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.383791] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.383795] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.383843] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.383888] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.383933] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.383977] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.384031] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.384075] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.384121] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.384166] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.384211] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.384312] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.385936] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.385965] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.385984] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.386009] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.386028] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.386048] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.386067] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.386086] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.386106] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.386125] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.386146] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.386165] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.386183] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.386201] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.386219] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.386237] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.386254] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.386272] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.386290] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.386308] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.386326] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.386354] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.386361] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.386364] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.387535] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.398221] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 10440 usecs347gitlab # [ 0.430534] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)348gitlab # [ 0.433241] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)349gitlab # [ 0.446688] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)350gitlab # [ 0.457308] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)351gitlab # [ 0.460437] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)352gitlab # [ 0.470136] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)353gitlab # [ 0.478961] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)354gitlab # [ 0.487035] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)355gitlab # [ 0.495987] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)356gitlab # [ 0.504651] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)357gitlab # [ 0.513370] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)358gitlab # [ 0.543435] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled359gitlab # [ 0.548650] msm_serial: driver initialized360gitlab # [ 0.548852] SuperH (H)SCI(F) driver initialized361gitlab # [ 0.548908] STM32 USART driver initialized362gitlab # [ 0.599938] loop: module loaded363gitlab # [ 0.602376] virtio_blk virtio4: 4/0/0 default/read/poll queues364gitlab # [ 0.610873] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)365gitlab # [ 0.616856] virtio_blk virtio5: 4/0/0 default/read/poll queues366gitlab # [ 0.619333] virtio_blk virtio5: [vdb] 12284544 512-byte logical blocks (6.29 GB/5.86 GiB)367gitlab # [ 0.624926] megasas: 07.734.00.00-rc1368gitlab # [ 0.626092] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]369gitlab # [ 0.629317] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000370gitlab # [ 0.629360] Intel/Sharp Extended Query Table at 0x0031371gitlab # [ 0.635157] Using buffer write method372gitlab # [ 0.635275] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]373gitlab # [ 0.638116] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000374gitlab # [ 0.638152] Intel/Sharp Extended Query Table at 0x0031375gitlab # [ 0.641319] Using buffer write method376gitlab # [ 0.641361] Concatenating MTD devices:377gitlab # [ 0.641364] (0): "0.flash"378gitlab # [ 0.641367] (1): "0.flash"379gitlab # [ 0.641369] into device "0.flash"380gitlab # [ 0.898655] Freeing initrd memory: 27184K381gitlab # [ 0.912411] tun: Universal TUN/TAP device driver, 1.6382gitlab # [ 0.916975] thunder_xcv, ver 1.0383gitlab # [ 0.917050] thunder_bgx, ver 1.0384gitlab # [ 0.917090] nicpf, ver 1.0385gitlab # [ 0.917778] e1000: Intel(R) PRO/1000 Network Driver386gitlab # [ 0.917783] e1000: Copyright (c) 1999-2006 Intel Corporation.387gitlab # [ 0.917846] e1000e: Intel(R) PRO/1000 Network Driver388gitlab # [ 0.917857] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.389gitlab # [ 0.917882] igb: Intel(R) Gigabit Ethernet Network Driver390gitlab # [ 0.917886] igb: Copyright (c) 2007-2014 Intel Corporation.391gitlab # [ 0.917925] igbvf: Intel(R) Gigabit Virtual Function Network Driver392gitlab # [ 0.917929] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.393gitlab # [ 0.918092] sky2: driver version 1.30394gitlab # [ 0.919938] usbcore: registered new interface driver usb-storage395gitlab # [ 0.920119] usbcore: registered new interface driver usbserial_generic396gitlab # [ 0.920143] usbserial: USB Serial support registered for generic397gitlab # [ 0.920804] hv_vmbus: registering driver hyperv_keyboard398gitlab # [ 0.922714] ehci-pci 0000:00:0a.0: EHCI Host Controller399gitlab # [ 0.922789] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1400gitlab # [ 0.923271] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000401gitlab # [ 0.924096] rtc-pl031 9010000.pl031: registered as rtc0402gitlab # [ 0.924147] rtc-pl031 9010000.pl031: setting system clock to 2026-09-04T07:39:35 UTC (1788507575)403gitlab # [ 0.924683] i2c_dev: i2c /dev entries driver404gitlab # [ 0.928041] sdhci: Secure Digital Host Controller Interface driver405gitlab # [ 0.928051] sdhci: Copyright(c) Pierre Ossman406gitlab # [ 0.928338] Synopsys Designware Multimedia Card Interface Driver407gitlab # [ 0.928722] sdhci-pltfm: SDHCI platform and OF driver helper408gitlab # [ 0.930906] hid: raw HID events driver (C) Jiri Kosina409gitlab # [ 0.931282] usbcore: registered new interface driver usbhid410gitlab # [ 0.931286] usbhid: USB HID core driver411gitlab # [ 0.937967] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00412gitlab # [ 0.938766] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available413gitlab # [ 0.940796] drop_monitor: Initializing network drop monitor service414gitlab # [ 0.941001] NET: Registered PF_INET6 protocol family415gitlab # [ 0.941782] hub 1-0:1.0: USB hub found416gitlab # [ 0.941863] hub 1-0:1.0: 6 ports detected417gitlab # [ 0.942161] Segment Routing with IPv6418gitlab # [ 0.942183] In-situ OAM (IOAM) with IPv6419gitlab # [ 0.942223] NET: Registered PF_PACKET protocol family420gitlab # [ 0.944567] 9pnet: Installing 9P2000 support421gitlab # [ 0.949930] Key type dns_resolver registered422gitlab # [ 0.962182] registered taskstats version 1423gitlab # [ 0.965106] Loading compiled-in X.509 certificates424gitlab # [ 0.980745] Demotion targets for Node 0: null425gitlab # [ 0.981013] Key type .fscrypt registered426gitlab # [ 0.981021] Key type fscrypt-provisioning registered427gitlab # [ 0.981209] ima: No TPM chip found, activating TPM-bypass!428gitlab # [ 0.981232] ima: Allocated hash algorithm: sha1429gitlab # [ 0.981271] ima: No architecture policies found430gitlab # [ 0.982739] input: gpio-keys as /devices/platform/gpio-keys/input/input0431gitlab # [ 1.020548] clk: Disabling unused clocks432gitlab # [ 1.021192] PM: genpd: Disabling unused power domains433gitlab # [ 1.025081] Freeing unused kernel memory: 4736K434gitlab # [ 1.025316] Run /init as init process435gitlab # [ 1.057059] systemd[1]: Successfully made /usr/ read-only.436gitlab # [ 1.194007] usb 1-1: new high-speed USB device number 2 using ehci-pci437gitlab # [ 1.354473] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1438gitlab # [ 1.391897] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.391952] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.392003] systemd[1]: Detected architecture arm64.441gitlab # [ 1.392012] systemd[1]: Running in initrd.442gitlab # [ 1.392482] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.392610] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.462404] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0445gitlab # [ 1.592967] usb 1-2: new high-speed USB device number 3 using ehci-pci446gitlab # [ 1.711787] systemd[1]: bpf-restrict-fs: LSM BPF program attached447gitlab # [ 1.820284] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2448gitlab # [ 1.822433] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0449gitlab # [ 1.854814] systemd[1]: Queued start job for default target Initrd Default Target.450gitlab # [ 1.882555] systemd[1]: Created slice Slice /system/modprobe.451gitlab # [ 1.883768] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.452gitlab # [ 1.884875] systemd[1]: Expecting device /dev/disk/by-label/nix-store...453gitlab # [ 1.884901] systemd[1]: Expecting device /dev/disk/by-label/nixos...454gitlab # [ 1.884942] systemd[1]: Reached target Path Units.455gitlab # [ 1.884961] systemd[1]: Reached target Slice Units.456gitlab # [ 1.884982] systemd[1]: Reached target Swaps.457gitlab # [ 1.885004] systemd[1]: Reached target Timer Units.458gitlab # [ 1.885279] systemd[1]: Listening on D-Bus System Message Bus Socket.459gitlab # [ 1.885449] systemd[1]: Listening on Journal Socket (/dev/log).460gitlab # [ 1.885586] systemd[1]: Listening on Journal Sockets.461gitlab # [ 1.889840] systemd[1]: Listening on udev Control Socket.462gitlab # [ 1.889987] systemd[1]: Listening on udev Kernel Socket.463gitlab # [ 1.890005] systemd[1]: Reached target Socket Units.464gitlab # [ 1.892088] systemd[1]: Starting Create List of Static Device Nodes...465gitlab # [ 1.898186] systemd[1]: Starting Load Kernel Module 9pnet_virtio...466gitlab # [ 1.898325] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs467gitlab # [ 1.922181] systemd[1]: Mounting Kernel Configuration File System...468gitlab # [ 1.955743] systemd[1]: Starting Journal Service...469gitlab # [ 1.970942] systemd[1]: Starting Load Kernel Modules...470gitlab # [ 1.971205] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os471gitlab # [ 1.979289] systemd[1]: Starting Coldplug All udev Devices...472gitlab # [ 1.985174] systemd[1]: Finished Create List of Static Device Nodes.473gitlab # [ 1.989002] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.474gitlab # [ 1.993403] systemd[1]: Finished Load Kernel Module 9pnet_virtio.475gitlab # [ 1.994653] systemd[1]: Mounted Kernel Configuration File System.476gitlab # [ 2.042094] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...477gitlab # [ 2.169331] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.478gitlab # [ 2.182644] systemd[1]: Starting Create Static Device Nodes in /dev...479gitlab # [ 2.196130] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.480gitlab # [ 2.200340] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0481gitlab # [ 2.200645] [drm] features: -virgl +edid -resource_blob -host_visible482gitlab # [ 2.200659] [drm] features: -context_init483gitlab # [ 2.214745] [drm] number of scanouts: 1484gitlab # [ 2.214797] [drm] number of cap sets: 0485gitlab # [ 2.217915] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev486gitlab # [ 2.224028] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic487gitlab # [ 2.224060] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0488gitlab # [ 2.233519] systemd-journald[96]: Collecting audit messages is disabled.489gitlab # [ 2.272738] Console: switching to colour frame buffer device 160x50490gitlab # [ 2.273432] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device491gitlab # [ 2.294420] systemd[1]: Finished Create Static Device Nodes in /dev.492gitlab # [ 2.294932] systemd[1]: Reached target Preparation for Local File Systems.493gitlab # [ 2.295032] systemd[1]: Reached target Local File Systems.494gitlab # [ 2.330132] systemd[1]: Starting Rule-based Manager for Device Events and Files...495gitlab # [ 2.356568] systemd[1]: Finished Load Kernel Modules.496gitlab # [ 2.359086] systemd[1]: Starting Apply Kernel Variables...497gitlab # [ 2.386930] systemd-modules-load[97]: Using 4 probe threads498gitlab # [ 2.389150] systemd-modules-load[97]: Module 'virtio_balloon' is built in499gitlab # [ 2.395029] systemd-modules-load[97]: Module 'virtio_console' is built in500gitlab # [ 2.396783] systemd-modules-load[97]: Module 'virtio_rng' is built in[ 2.402077] systemd[1]: Finished Apply Kernel Variables.501gitlab # [ 2.406427] systemd[1]: Started Journal Service.502gitlab # 503gitlab # [ 2.405028] systemd-modules-load[97]: Inserted module 'dm_mod'504gitlab # [ 2.414870] systemd-modules-load[97]: Inserted module 'virtio_gpu'505gitlab # [ 2.424592] systemd[1]: Starting Create System Files and Directories...506gitlab # [ 2.455297] systemd[1]: Finished Create System Files and Directories.507gitlab # [ 2.472802] systemd-udevd[105]: Using default interface naming scheme 'v261'.508gitlab # [ 2.518247] systemd[1]: Started Rule-based Manager for Device Events and Files.509gitlab # [ 2.564919] systemd[1]: Starting Virtual Console Setup...510gitlab # [ 2.612498] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.511gitlab # [ 2.615726] systemd[1]: Finished Virtual Console Setup.512gitlab # [ 2.956320] systemd[1]: Finished Coldplug All udev Devices.513gitlab # [ 2.957426] systemd[1]: Reached target System Initialization.514gitlab # [ 2.958241] systemd[1]: Reached target Basic System.515gitlab # [ 3.336471] (udev-worker)[143]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 3.351389] (udev-worker)[142]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.517gitlab # [ 3.357677] (udev-worker)[142]: Network interface NamePolicy= disabled on kernel command line.518gitlab # [ 3.416653] systemd[1]: Found device /dev/disk/by-label/nixos.519gitlab # [ 3.422139] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 3.437612] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 3.496135] systemd[1]: Found device /dev/disk/by-label/nix-store.522gitlab # [ 3.537278] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks523gitlab # [ 3.552290] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.524gitlab # [ 3.566465] systemd[1]: Mounting /sysroot...525gitlab # [ 3.806711] EXT4-fs (vda): mounted filesystem bedf2449-9d00-4345-9770-20337a7ca707 r/w with ordered data mode. Quota mode: none.526gitlab # [ 3.804740] systemd[1]: Mounted /sysroot.527gitlab # [ 3.830622] systemd[1]: Reached target Initrd Root File System.528gitlab # [ 3.844558] systemd[1]: Mounting /sysroot/nix/.ro-store...529gitlab # [ 3.856346] systemd[1]: Mounting /sysroot/nix/.rw-store...530gitlab # [ 3.884561] systemd[1]: Mounting /sysroot/run...531gitlab # [ 3.902952] systemd[1]: Mounting /sysroot/tmp/shared...532gitlab # [ 3.915229] systemd[1]: Mounting /sysroot/tmp/xchg...533gitlab # [ 3.980168] systemd[1]: Starting Mountpoints Configured in the Real Root...534gitlab # [ 3.981568] systemd[1]: Mounted /sysroot/nix/.rw-store.535gitlab # [ 3.982728] systemd[1]: Mounted /sysroot/run.536gitlab # [ 3.996879] systemd[1]: Mounted /sysroot/tmp/shared.[ 4.010102] erofs (device vdb): mounted with root inode @ nid 128.537gitlab # 538gitlab # [ 4.008652] systemd[1]: Mounted /sysroot/tmp/xchg.539gitlab # [ 4.061182] systemd[1]: Starting rw-sysroot-nix-store.service...540gitlab # [ 4.064717] systemd[1]: Mounted /sysroot/nix/.ro-store.541gitlab # [ 4.076769] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.542gitlab # [ 4.084262] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.543gitlab # [ 4.086079] systemd[1]: Finished rw-sysroot-nix-store.service.544gitlab # [ 4.093076] systemd[1]: Mounting /sysroot/nix/store...545gitlab # [ 4.095209] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...546gitlab # [ 4.100235] systemd[1]: Reloading...547gitlab # [ 4.321727] systemd[1]: Reloading finished in 223 ms.548gitlab # [ 4.491469] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...549gitlab # [ 4.566500] systemd[1]: Mounted /sysroot/nix/store.550gitlab # [ 4.581121] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...551gitlab # [ 4.584547] systemd[1]: Starting Find NixOS closure...552gitlab # [ 4.585516] systemd[1]: initrd-parse-etc.service: Deactivated successfully.553gitlab # [ 4.586680] systemd[1]: Finished Mountpoints Configured in the Real Root.554gitlab # [ 4.592297] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.555gitlab # [ 4.594107] systemd[1]: Reached target Initrd File Systems.556gitlab # [ 4.608691] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...557gitlab # [ 4.656257] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.558gitlab # [ 4.659261] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.559gitlab # [ 4.683086] systemd[1]: Finished Find NixOS closure.560gitlab # [ 4.701357] systemd[1]: Reached target Initrd Default Target.561gitlab # [ 4.702359] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...562gitlab # [ 4.780640] systemd[1]: Stopped target Initrd Default Target.563gitlab # [ 4.782629] systemd[1]: Stopped target Basic System.564gitlab # [ 4.783399] systemd[1]: Stopped target Initrd Root Device.565gitlab # [ 4.785178] systemd[1]: Stopped target Path Units.566gitlab # [ 4.786375] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.567gitlab # [ 4.794378] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.568gitlab # [ 4.799617] systemd[1]: Stopped target Slice Units.569gitlab # [ 4.818422] systemd[1]: Stopped target Socket Units.570gitlab # [ 4.819350] systemd[1]: Stopped target System Initialization.571gitlab # [ 4.832632] systemd[1]: Stopped target Swaps.572gitlab # [ 4.833563] systemd[1]: Stopped target Timer Units.573gitlab # [ 4.834343] systemd[1]: dbus.socket: Deactivated successfully.574gitlab # [ 4.835198] systemd[1]: Closed D-Bus System Message Bus Socket.575gitlab # [ 4.838486] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.576gitlab # [ 4.839663] systemd[1]: Stopped Find NixOS closure.577gitlab # [ 4.843321] systemd[1]: Starting Load Kernel Module 9pnet_virtio...578gitlab # [ 4.844454] systemd[1]: Starting rw-sysroot-nix-store.service...579gitlab # [ 4.852847] systemd[1]: systemd-sysctl.service: Deactivated successfully.580gitlab # [ 4.854402] systemd[1]: Stopped Apply Kernel Variables.581gitlab # [ 4.855534] systemd[1]: systemd-modules-load.service: Deactivated successfully.582gitlab # [ 4.876324] systemd[1]: Stopped Load Kernel Modules.583gitlab # [ 4.877099] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.584gitlab # [ 4.878148] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.585gitlab # [ 4.879172] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.586gitlab # [ 4.890072] systemd[1]: Stopped Create System Files and Directories.587gitlab # [ 4.891182] systemd[1]: Stopped target Local File Systems.588gitlab # [ 4.894664] systemd[1]: Stopped target Preparation for Local File Systems.589gitlab # [ 4.934044] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.590gitlab # [ 4.935243] systemd[1]: Stopped Coldplug All udev Devices.591gitlab # [ 4.936879] systemd[1]: Stopping Rule-based Manager for Device Events and Files...592gitlab # [ 4.969084] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.593gitlab # [ 4.970233] systemd[1]: Stopped Virtual Console Setup.594gitlab # [ 4.971012] systemd[1]: initrd-cleanup.service: Deactivated successfully.595gitlab # [ 4.973112] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.596gitlab # [ 4.974155] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.597gitlab # [ 4.975193] systemd[1]: Finished Load Kernel Module 9pnet_virtio.598gitlab # [ 4.976201] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.599gitlab # [ 4.977256] systemd[1]: Finished rw-sysroot-nix-store.service.600gitlab # [ 5.002217] systemd[1]: systemd-udevd.service: Deactivated successfully.601gitlab # [ 5.003551] systemd[1]: Stopped Rule-based Manager for Device Events and Files.602gitlab # [ 5.004749] systemd[1]: systemd-udevd.service: Consumed 2.777s CPU time over 2.681s wall clock time, 23.9M memory peak.603gitlab # [ 5.006582] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.604gitlab # [ 5.007648] systemd[1]: Closed udev Control Socket.605gitlab # [ 5.011002] systemd[1]: Starting Cleanup udev Database...606gitlab # [ 5.012379] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.607gitlab # [ 5.013494] systemd[1]: Stopped Create Static Device Nodes in /dev.608gitlab # [ 5.014359] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.609gitlab # [ 5.015470] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.610gitlab # [ 5.017249] systemd[1]: kmod-static-nodes.service: Deactivated successfully.611gitlab # [ 5.018270] systemd[1]: Stopped Create List of Static Device Nodes.612gitlab # [ 5.064326] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.613gitlab # [ 5.065788] systemd[1]: Finished Cleanup udev Database.614gitlab # [ 5.066595] systemd[1]: Reached target Switch Root.615gitlab # [ 5.068550] systemd[1]: Starting NixOS Activation...616gitlab # [ 5.262640] initrd-nixos-activation-start[212]: booting system configuration /nix/store/smnpmdfnnaian54wpragz0ra1sdavzj3-nixos-system-gitlab-test617gitlab # [ 5.333732] initrd-nixos-activation-start[212]: running activation script...618gitlab # [ 5.737214] initrd-nixos-activation-start[235]: setting up /etc...619gitlab # [ 5.922295] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.620gitlab # [ 5.926871] systemd[1]: Finished NixOS Activation.621gitlab # [ 5.933443] systemd[1]: Starting Switch Root...622gitlab # [ 5.972921] systemd[1]: Switching root.623gitlab # [ 6.057341] systemd-journald[96]: Received SIGTERM from PID 1 (systemd).624gitlab # [ 6.674767] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)625gitlab # [ 6.677877] systemd[1]: Detected virtualization qemu.626gitlab # [ 6.677947] systemd[1]: Detected architecture arm64.627gitlab # [ 6.678069] systemd[1]: Detected first boot.628gitlab # [ 6.678818] systemd[1]: Initializing machine ID from random generator.629gitlab # [ 6.914434] systemd[1]: bpf-restrict-fs: LSM BPF program attached630gitlab # [ 7.167379] systemd[1]: Applying preset policy.631gitlab # [ 7.621929] systemd[1]: Populated /etc with preset unit settings.632gitlab # [ 8.027449] systemd[1]: initrd-switch-root.service: Deactivated successfully.633gitlab # [ 8.028100] systemd[1]: Stopped initrd-switch-root.service.634gitlab # [ 8.032067] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.635gitlab # [ 8.035817] systemd[1]: Created slice Slice /system/getty.636gitlab # [ 8.038959] systemd[1]: Created slice GitLab DevOps Platform Slice.637gitlab # [ 8.042357] systemd[1]: Created slice User and Session Slice.638gitlab # [ 8.043178] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.639gitlab # [ 8.043739] systemd[1]: Started Forward Password Requests to Wall Directory Watch.640gitlab # [ 8.044157] systemd[1]: Expecting device /dev/hvc0...641gitlab # [ 8.044526] systemd[1]: Expecting device /dev/ttyAMA0...642gitlab # [ 8.044892] systemd[1]: Reached target Local Encrypted Volumes.643gitlab # [ 8.045261] systemd[1]: Stopped target initrd-fs.target.644gitlab # [ 8.045621] systemd[1]: Stopped target initrd-root-fs.target.645gitlab # [ 8.046300] systemd[1]: Stopped target initrd-switch-root.target.646gitlab # [ 8.046705] systemd[1]: Reached target Virtual Machines and Containers.647gitlab # [ 8.047086] systemd[1]: Reached target Path Units.648gitlab # [ 8.047426] systemd[1]: Reached target Remote File Systems.649gitlab # [ 8.047750] systemd[1]: Reached target Slice Units.650gitlab # [ 8.048066] systemd[1]: Reached target Swaps.651gitlab # [ 8.049656] systemd[1]: Listening on Query the User Interactively for a Password.652gitlab # [ 8.067666] systemd[1]: Listening on Process Core Dump Socket.653gitlab # [ 8.074868] systemd[1]: Listening on Credential Encryption/Decryption.654gitlab # [ 8.077630] systemd[1]: Listening on Factory Reset Management.655gitlab # [ 8.079733] systemd[1]: Listening on Hostname Service Socket.656gitlab # [ 8.090986] systemd[1]: Starting Journal Log Access Socket...657gitlab # [ 8.095069] systemd[1]: Listening on Journal Audit Socket.658gitlab # [ 8.097123] systemd[1]: Listening on Console Output Muting Service Socket.659gitlab # [ 8.101747] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.660gitlab # [ 8.103640] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os661gitlab # [ 8.104149] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki662gitlab # [ 8.107074] systemd[1]: Listening on Disk Repartitioning Service Socket.663gitlab # [ 8.107733] systemd[1]: Listening on udev Control Socket.664gitlab # [ 8.108294] systemd[1]: Listening on udev Varlink Socket.665gitlab # [ 8.134449] systemd[1]: Mounting Huge Pages File System...666gitlab # [ 8.147378] systemd[1]: Mounting POSIX Message Queue File System...667gitlab # [ 8.182102] systemd[1]: Mounting Kernel Debug File System...668gitlab # [ 8.194065] systemd[1]: Mounting Kernel Trace File System...669gitlab # [ 8.202032] systemd[1]: Starting Create List of Static Device Nodes...670gitlab # [ 8.209967] systemd[1]: Starting Load Kernel Module 9pnet_virtio...671gitlab # [ 8.210723] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs672gitlab # [ 8.222020] systemd[1]: Mounting Kernel Configuration File System...673gitlab # [ 8.222778] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm674gitlab # [ 8.223268] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore675gitlab # [ 8.233366] systemd[1]: Starting Load Kernel Module fuse...676gitlab # [ 8.234216] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67677gitlab # [ 8.282305] systemd[1]: Starting Journal Service...678gitlab # [ 8.292262] systemd[1]: Starting Load Kernel Modules...679gitlab # [ 8.365209] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...680gitlab # [ 8.374946] fuse: init (API version 7.45)681gitlab # [ 8.394329] systemd[1]: Starting Remount Root and Kernel File Systems...682gitlab # [ 8.395116] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os683gitlab # [ 8.402271] systemd-journald[307]: Collecting audit messages is enabled.684gitlab # [ 8.414027] systemd[1]: Queued start job for default target Multi-User System.685gitlab # [ 8.420615] systemd[1]: Unnecessary job was removed for /dev/vdb.686gitlab # [ 8.422625] systemd[1]: systemd-journald.service: Deactivated successfully.687gitlab # [ 8.434601] systemd[1]: Starting Coldplug All udev Devices...688gitlab # [ 8.425602] systemd-modules-load[308]: Using 3 probe threads689gitlab # [ 8.432124] systemd-modules-load[308]: Module 'atkbd' is built in690gitlab # [ 8.434214] systemd-modules-load[308]: Module 'loop' is built in[ 8.443619] systemd[1]: Started Journal Service.691gitlab # 692gitlab # [ 8.449210] systemd-modules-load[308]: Inserted module 'tls'693gitlab # [ 8.454888] systemd[1]: Listening on Journal Log Access Socket.694gitlab # [ 8.462981] systemd[1]: Mounted Huge Pages File System.695gitlab # [ 8.464981] systemd[1]: Mounted POSIX Message Queue File System.696gitlab # [ 8.468518] systemd[1]: Mounted Kernel Debug File System.697gitlab # [ 8.472466] systemd[1]: Mounted Kernel Trace File System.698gitlab # [ 8.484923] EXT4-fs (vda): re-mounted bedf2449-9d00-4345-9770-20337a7ca707.699gitlab # [ 8.491218] systemd[1]: Finished Create List of Static Device Nodes.700gitlab # [ 8.501203] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.701gitlab # [ 8.502288] systemd[1]: Finished Load Kernel Module 9pnet_virtio.702gitlab # [ 8.503143] systemd[1]: Mounted Kernel Configuration File System.703gitlab # [ 8.504404] systemd[1]: modprobe@fuse.service: Deactivated successfully.704gitlab # [ 8.506293] systemd[1]: Finished Load Kernel Module fuse.705gitlab # [ 8.507697] systemd[1]: Finished Load Kernel Modules.706gitlab # [ 8.509041] systemd[1]: Finished Remount Root and Kernel File Systems.707gitlab # [ 8.510698] systemd[1]: Listening on Disk Image Download Service Socket.708gitlab # [ 8.514672] systemd[1]: Mounting FUSE Control File System...709gitlab # [ 8.560340] systemd[1]: Starting Firewall...710gitlab # [ 8.571990] systemd-oomd[310]: No swap; memory pressure usage will be degraded711gitlab # [ 8.578328] systemd[1]: Starting Flush Journal to Persistent Storage...712gitlab # [ 8.588189] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore713gitlab # [ 8.596457] systemd[1]: Starting Load/Save OS Random Seed...714gitlab # [ 8.602517] systemd[1]: Starting Apply Kernel Variables...715gitlab # [ 8.624218] systemd-journald[307]: Received client request to flush runtime journal.716gitlab # [ 8.678056] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...717gitlab # [ 8.680899] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os718gitlab # [ 8.683661] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.719gitlab # [ 8.685560] systemd[1]: Mounted FUSE Control File System.720gitlab # [ 8.686799] systemd[1]: Finished Apply Kernel Variables.721gitlab # [ 8.687984] systemd[1]: Finished Load/Save OS Random Seed.722gitlab # [ 8.701567] systemd[1]: Reached target First Boot Complete.723gitlab # [ 8.702636] systemd[1]: Finished Flush Journal to Persistent Storage.724gitlab # [ 8.740361] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.725gitlab # [ 8.768773] systemd[1]: Starting Create Static Device Nodes in /dev...726gitlab # [ 8.811120] systemd[1]: Finished Create Static Device Nodes in /dev.727gitlab # [ 8.820909] systemd[1]: Reached target Preparation for Local File Systems.728gitlab # [ 8.829685] systemd[1]: Starting Rule-based Manager for Device Events and Files...729gitlab # [ 9.036568] systemd[1]: Mounting /run/wrappers...730gitlab # [ 9.066188] systemd-udevd[359]: Using default interface naming scheme 'v261'.731gitlab # [ 9.143035] systemd[1]: Mounted /run/wrappers.732gitlab # [ 9.157219] systemd[1]: Reached target Local File Systems.733gitlab # [ 9.171158] systemd[1]: Listening on Boot Loader Control Service Socket.734gitlab # [ 9.200867] systemd[1]: Starting register-nix-paths.service...735gitlab # [ 9.273863] systemd[1]: Starting Create SUID/SGID Wrappers...736gitlab # [ 9.281557] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.737gitlab # [ 9.344858] systemd[1]: Starting Save Transient machine-id to Disk...738gitlab # [ 9.381891] systemd[1]: Starting Create System Files and Directories...739gitlab # [ 9.469677] systemd[1]: Started Rule-based Manager for Device Events and Files.740gitlab # [ 9.489765] systemd[1]: Finished Create System Files and Directories.741gitlab # [ 9.511124] systemd[1]: Starting Rebuild Journal Catalog...742gitlab # [ 9.568141] systemd[1]: Starting Record System Boot/Shutdown in UTMP...743gitlab # [ 9.570279] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.744gitlab # [ 9.581202] systemd[1]: Finished Save Transient machine-id to Disk.745gitlab # [ 9.613796] systemd[1]: Finished Record System Boot/Shutdown in UTMP.746gitlab # [ 9.642908] systemd[1]: Finished Rebuild Journal Catalog.747gitlab # [ 9.676676] systemd[1]: Starting Update is Completed...748gitlab # [ 9.720774] systemd[1]: Finished Coldplug All udev Devices.749gitlab # [ 9.750867] systemd[1]: Finished Update is Completed.750gitlab # [ 9.990945] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.751gitlab # [ 9.993500] systemd[1]: Finished Create SUID/SGID Wrappers.752gitlab # [ 9.994474] systemd[1]: suid-sgid-wrappers.service: Consumed 237ms CPU time over 715ms wall clock time, 5.8M memory peak, 1.9M read from disk.753gitlab # [ 10.062218] systemd[1]: Finished Firewall.754gitlab # [ 10.607154] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3755gitlab # [ 10.757207] systemd[1]: Starting Virtual Console Setup...756gitlab # [ 10.786386] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.757gitlab # [ 10.790641] systemd[1]: Stopped Virtual Console Setup.758gitlab # [ 10.792733] systemd[1]: Finished register-nix-paths.service.759gitlab # [ 10.819082] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs760gitlab # [ 10.833086] systemd[1]: Starting Virtual Console Setup...761gitlab # [ 10.967602] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.762gitlab # [ 11.008675] systemd-vconsole-setup[550]: Configuration of first virtual console was skipped, ignoring remaining ones.763gitlab # [ 11.012649] systemd[1]: Finished Virtual Console Setup.764gitlab # [ 11.018385] systemd[1]: Reached target System Initialization.765gitlab # [ 11.021153] systemd[1]: Started Discard unused filesystem blocks once a week.766gitlab # [ 11.032416] systemd[1]: Started logrotate.timer.767gitlab # [ 11.033965] systemd[1]: Started Daily Cleanup of Temporary Directories.768gitlab # [ 11.035417] systemd[1]: Reached target Timer Units.769gitlab # [ 11.036725] systemd[1]: Listening on D-Bus System Message Bus Socket.770gitlab # [ 11.038094] systemd[1]: Listening on Nix Daemon Socket.771gitlab # [ 11.052740] (udev-worker)[479]: Network interface NamePolicy= disabled on kernel command line.772gitlab # [ 11.063558] systemd[1]: Starting nixbot CI service socket...773gitlab # [ 11.068744] (udev-worker)[467]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.774gitlab # [ 11.074168] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.775gitlab # [ 11.080254] (udev-worker)[467]: Network interface NamePolicy= disabled on kernel command line.776gitlab # [ 11.082384] systemd[1]: Listening on nixbot CI service socket.777gitlab # [ 11.097688] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.778gitlab # [ 11.099729] systemd[1]: Reached target Socket Units.779gitlab # [ 11.128508] systemd[1]: Starting D-Bus System Message Bus...780gitlab # [ 11.153062] systemd[1]: Condition check resulted in Virtio network device being skipped.781gitlab # [ 11.353812] hrtimer: interrupt took 35931300 ns782gitlab # [ 11.378581] mousedev: PS/2 mouse device common for all mice783gitlab # [ 11.382872] dbus-broker-launch[560]: Looking up NSS user entry for 'systemd-timesync'...784gitlab # [ 11.390156] dbus-broker-launch[560]: NSS returned no entry for 'systemd-timesync'785gitlab # [ 11.393160] dbus-broker-launch[560]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"786gitlab # [ 11.411152] systemd[1]: Started D-Bus System Message Bus.787gitlab # [ 11.447471] dbus-broker-launch[560]: Ready788gitlab # [ 11.452857] systemd[1]: Reached target Basic System.789gitlab # [ 11.468496] systemd[1]: Started backdoor.service.790gitlab # [ 11.501628] systemd[1]: Starting gitlab-config.service...791gitlab # connecting to host...792gitlab # [ 11.560105] systemd[1]: Starting Import lastlog data into lastlog2 database...793gitlab # [ 11.599507] systemd[1]: Starting Logrotate configuration check...794gitlab # [ 11.628174] systemd[1]: Starting Name Service Cache Daemon (nsncd)...795gitlab: Guest shell says: b'Spawning backdoor root shell...\n'796gitlab: connected to guest root shell797gitlab # [ 11.652598] logrotate[568]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.798gitlab # [ 11.654810] logrotate[568]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf799gitlab: (connecting took 12.14 seconds)800gitlab: (finished: waiting for the VM to finish booting, in 12.14 seconds)801gitlab # [ 11.658001] logrotate[568]: note: 'monthly' overrides previously specified 'weekly'802gitlab # [ 11.668166] logrotate[568]: Reading state from file: /var/lib/logrotate.status803gitlab # [ 11.669121] logrotate[568]: state file /var/lib/logrotate.status does not exist804gitlab # [ 11.670006] logrotate[568]: Allocating hash table for state file, size 64 entries805gitlab # [ 11.670903] logrotate[568]: Handling 4 logs806gitlab # [ 11.671443] logrotate[568]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed807gitlab # [ 11.684376] logrotate[568]: considering log /var/log/btmp808gitlab # [ 11.694574] logrotate[568]: Creating new state809gitlab # [ 11.719065] logrotate[568]: Now: 2026-09-04 07:39810gitlab # [ 11.720971] logrotate[568]: Last rotated at 2026-09-04 07:00811gitlab # [ 11.722189] logrotate[568]: log does not need rotating (log has already been rotated)812gitlab # [ 11.728825] logrotate[568]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed813gitlab # [ 11.730809] logrotate[568]: considering log /var/log/wtmp814gitlab # [ 11.731507] logrotate[568]: Creating new state815gitlab # [ 11.736695] logrotate[568]: Now: 2026-09-04 07:39816gitlab # [ 11.737728] logrotate[568]: Last rotated at 2026-09-04 07:00817gitlab # [ 11.738864] logrotate[568]: log does not need rotating (log has already been rotated)818gitlab # [ 11.744334] logrotate[568]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed819gitlab # [ 11.746032] logrotate[568]: switching euid from 0 to 165 and egid from 0 to 165 (pid 568)820gitlab # [ 11.747025] logrotate[568]: considering log /var/gitlab/state/log/*.log821gitlab # [ 11.752023] logrotate[568]: log /var/gitlab/state/log/*.log does not exist -- skipping822gitlab # [ 11.761229] logrotate[568]: Creating new state823gitlab # [ 11.762667] logrotate[568]: switching euid from 165 to 0 and egid from 165 to 0 (pid 568)824gitlab # [ 11.764491] logrotate[568]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed825gitlab # [ 11.769385] logrotate[568]: switching euid from 0 to 60 and egid from 0 to 60 (pid 568)826gitlab # [ 11.773427] logrotate[568]: considering log /var/log/nginx/*.log827gitlab # [ 11.776199] logrotate[568]: log /var/log/nginx/*.log does not exist -- skipping828gitlab # [ 11.781018] logrotate[568]: Creating new state829gitlab # [ 11.781681] logrotate[568]: not running postrotate script, since no logs were rotated830gitlab # [ 11.782638] logrotate[568]: switching euid from 60 to 0 and egid from 60 to 0 (pid 568)831gitlab # [ 11.791263] systemd[1]: Starting Post-Boot Actions...832gitlab # [ 11.799444] systemd[1]: Started Reset console on configuration changes.833gitlab # [ 11.801088] systemd[1]: Starting resolvconf update...834gitlab # [ 11.832212] systemd[1]: Finished Logrotate configuration check.835gitlab # [ 11.848928] systemd[1]: Finished Post-Boot Actions.836gitlab # [ 11.871096] systemd[1]: Finished Import lastlog data into lastlog2 database.837gitlab # [ 11.916431] systemd[1]: Started Name Service Cache Daemon (nsncd).838gitlab # [ 11.920243] nsncd[571]: Sep 04 07:39:46.497 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"839gitlab # [ 11.936864] systemd[1]: Reached target Host and Network Name Lookups.840gitlab # [ 11.944224] systemd[1]: Reached target User and Group Name Lookups.841gitlab # [ 11.953091] systemd[1]: Starting User Login Management...842gitlab # [ 12.136161] systemd[1]: Stopped target Host and Network Name Lookups.843gitlab # [ 12.143424] systemd[1]: Stopping Host and Network Name Lookups...844gitlab # [ 12.149958] systemd[1]: Stopped target User and Group Name Lookups.845gitlab # [ 12.151932] systemd[1]: Stopping User and Group Name Lookups...846gitlab # [ 12.164394] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...847gitlab # [ 12.166203] systemd[1]: nscd.service: Deactivated successfully.848gitlab # [ 12.167618] systemd[1]: Stopped Name Service Cache Daemon (nsncd).849gitlab # [ 12.172558] systemd[1]: nscd.service: Consumed 66ms CPU time over 531ms wall clock time, 7.4M memory peak, 5.8M read from disk.850gitlab # [ 12.196216] systemd[1]: Starting Name Service Cache Daemon (nsncd)...851gitlab # [ 12.222646] systemd-logind[623]: New seat seat0.852gitlab # [ 12.240507] systemd-logind[623]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)853gitlab # [ 12.244425] systemd-logind[623]: Watching system buttons on /dev/input/event0 (gpio-keys)854gitlab # [ 12.248483] systemd[1]: Started User Login Management.855gitlab # [ 12.256887] nsncd[677]: Sep 04 07:39:46.831 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"856gitlab # [ 12.268712] systemd[1]: Starting linger-users.service...857gitlab # [ 12.291229] systemd[1]: Started Name Service Cache Daemon (nsncd).858gitlab # [ 12.306406] systemd[1]: Reached target Host and Network Name Lookups.859gitlab # [ 12.337072] systemd[1]: Reached target User and Group Name Lookups.860gitlab # [ 12.352264] systemd[1]: linger-users.service: Deactivated successfully.861gitlab # [ 12.354067] systemd[1]: Finished linger-users.service.862gitlab # [ 12.387292] systemd[1]: Finished resolvconf update.863gitlab # [ 12.396183] systemd[1]: Reached target Preparation for Network.864gitlab # [ 12.414948] systemd[1]: Starting DHCP Client...865gitlab # [ 12.454993] systemd[1]: Starting Address configuration of eth1...866gitlab # [ 12.497320] systemd[1]: Starting Extra networking commands....867gitlab # [ 12.626283] network-addresses-eth1-start[707]: adding address 192.168.1.1/24... done868gitlab # [ 12.637744] network-addresses-eth1-start[707]: adding address 2001:db8:1::1/64... done869gitlab # [ 12.679203] systemd[1]: Finished Address configuration of eth1.870gitlab # [ 12.876869] dhcpcd[726]: dhcpcd-10.3.2 starting871gitlab # [ 12.889533] dhcpcd[768]: dev: loaded udev872gitlab # [ 12.906302] systemd[1]: Finished Extra networking commands..873gitlab # [ 12.917446] systemd[1]: Reached target Network.874gitlab # [ 12.927361] systemd[1]: Starting gitlab-workhorse.service...875gitlab # [ 12.949988] systemd[1]: Starting Nginx Web Server...876gitlab # [ 12.966211] 8021q: 802.1Q VLAN Support v1.8877gitlab # [ 12.966716] 8021q: adding VLAN 0 to HW filter on device eth1878gitlab # [ 12.975584] systemd[1]: Starting PostgreSQL Server...879gitlab # [ 12.996130] systemd[1]: Starting Redis Server - redis-gitlab...880gitlab # [ 13.008948] systemd[1]: Starting Permit User Sessions...881gitlab # [ 13.125673] systemd[1]: Finished Permit User Sessions.882gitlab # [ 13.289234] systemd[1]: Started Getty on tty1.883gitlab # [ 13.290669] systemd[1]: Reached target Login Prompts.884gitlab # [ 13.399116] cfg80211: Loading compiled-in X.509 certificates for regulatory database885gitlab # [ 13.414651] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'886gitlab # [ 13.415319] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'887gitlab # [ 13.420242] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2888gitlab # [ 13.420698] cfg80211: failed to load regulatory.db889gitlab # [ 13.564691] nginx-pre-start[807]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok890gitlab # [ 13.569566] nginx-pre-start[807]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful891gitlab # [ 13.596850] 8021q: adding VLAN 0 to HW filter on device eth0892gitlab # [ 13.588170] systemd[1]: Started Nginx Web Server.893gitlab # [ 13.607274] dhcpcd[768]: libudev: received NULL device894gitlab # [ 13.609130] dhcpcd[768]: eth0: waiting for carrier895gitlab # [ 13.620751] dhcpcd[768]: libudev: received NULL device896gitlab # [ 13.629954] dhcpcd[768]: eth0: carrier acquired897gitlab # [ 13.677514] postgresql-pre-start[808]: The files belonging to this database system will be owned by user "postgres".898gitlab # [ 13.696992] postgresql-pre-start[808]: This user must also own the server process.899gitlab # [ 13.704009] dhcpcd[768]: DUID 00:01:00:01:32:2d:32:44:52:54:00:12:34:56900gitlab # [ 13.706735] dhcpcd[768]: eth0: IAID 00:12:34:56901gitlab # [ 13.722970] dhcpcd[768]: eth0: adding address fe80::5054:ff:fe12:3456902gitlab # [ 13.737177] postgresql-pre-start[808]: The database cluster will be initialized with locale "en_US.UTF-8".903gitlab # [ 13.739187] postgresql-pre-start[808]: The default database encoding has accordingly been set to "UTF8".904gitlab # [ 13.742547] postgresql-pre-start[808]: The default text search configuration will be set to "english".905gitlab # [ 13.745308] postgresql-pre-start[808]: Data page checksums are enabled.906gitlab # [ 13.750825] postgresql-pre-start[808]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok907gitlab # [ 13.761746] postgresql-pre-start[808]: creating subdirectories ... ok908gitlab # [ 13.765789] postgresql-pre-start[808]: selecting dynamic shared memory implementation ... posix909gitlab # [ 13.833982] postgresql-pre-start[808]: selecting default "max_connections" ... 100910gitlab # [ 13.880649] redis-server[805]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.911gitlab # [ 13.882737] redis-server[805]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo912gitlab # [ 13.885200] redis-server[805]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=805, just started913gitlab # [ 13.896611] redis-server[805]: Configuration loaded914gitlab # [ 13.904858] redis[805]: monotonic clock: ARM CNTVCT @ 1000 ticks/us915gitlab # [ 13.909354] systemd[1]: Started Redis Server - redis-gitlab.916gitlab # [ 13.910637] redis[805]: Running mode=standalone, port=0.917gitlab # [ 13.911939] redis[805]: Server initialized918gitlab # [ 13.913511] redis[805]: Ready to accept connections unix919gitlab # [ 13.915621] redis[805]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.920gitlab # [ 13.956480] postgresql-pre-start[808]: selecting default "shared_buffers" ... 128MB921gitlab # [ 13.982934] dhcpcd[768]: eth0: soliciting a DHCP lease922gitlab # [ 14.007767] dhcpcd[768]: eth0: offered 10.0.2.15 from 10.0.2.2923gitlab # [ 14.031533] dhcpcd[768]: eth0: probing address 10.0.2.15/24924gitlab # [ 14.308729] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.925gitlab # [ 14.314373] systemd[1]: Stopped Virtual Console Setup.926gitlab # [ 14.340280] systemd[1]: systemd-vconsole-setup.service: Consumed 60ms CPU time over 3.473s wall clock time, 3.4M memory peak, 1.1M read from disk.927gitlab # [ 14.360227] systemd[1]: Stopping Virtual Console Setup...928gitlab # [ 14.373221] systemd[1]: Starting Virtual Console Setup...929gitlab # [ 14.404781] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.930gitlab # [ 14.429035] systemd[1]: Stopped Virtual Console Setup.931gitlab # [ 14.443517] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.932gitlab # [ 14.461293] systemd[1]: Starting Virtual Console Setup...933gitlab # [ 14.475267] systemd-logind[623]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)934gitlab # [ 14.567470] systemd-vconsole-setup[851]: Configuration of first virtual console was skipped, ignoring remaining ones.935gitlab # [ 14.572096] systemd[1]: Finished Virtual Console Setup.936gitlab # [ 14.995420] postgresql-pre-start[808]: selecting default time zone ... UTC937gitlab # [ 15.002352] postgresql-pre-start[808]: creating configuration files ... ok938gitlab # [ 15.180653] systemd[1]: Started gitlab-workhorse.service.939gitlab # [ 15.340231] postgresql-pre-start[808]: running bootstrap script ... ok940gitlab # [ 15.552736] dhcpcd[768]: eth0: soliciting an IPv6 router941gitlab # [ 15.558837] dhcpcd[768]: eth0: Router Advertisement from fe80::2942gitlab # [ 15.568301] dhcpcd[768]: eth0: adding address fec0::5054:ff:fe12:3456/64943gitlab # [ 15.569484] dhcpcd[768]: eth0: adding route to fec0::/64944gitlab # [ 15.570258] dhcpcd[768]: eth0: adding default route via fe80::2945gitlab # [ 15.824658] gitlab-workhorse[862]: time="2026-09-04T07:39:50Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4946gitlab # [ 15.826267] gitlab-workhorse[862]: time="2026-09-04T07:39:50Z" level=info msg="Using redis/go-redis"947gitlab # [ 15.838202] gitlab-workhorse[862]: time="2026-09-04T07:39:50Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix948gitlab # [ 16.358789] postgresql-pre-start[808]: performing post-bootstrap initialization ... ok949gitlab # [ 17.108653] postgresql-pre-start[808]: syncing data to disk ... ok950gitlab # [ 17.108893] postgresql-pre-start[808]: initdb: warning: enabling "trust" authentication for local connections951gitlab # [ 17.108936] postgresql-pre-start[808]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.952gitlab # [ 17.108970] postgresql-pre-start[808]: Success. You can now start the database server using:953gitlab # [ 17.109049] postgresql-pre-start[808]: pg_ctl -D /var/lib/postgresql/18 -l logfile start954gitlab # [ 17.314735] postgres[896]: [896] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit955gitlab # [ 17.320333] postgres[896]: [896] LOG: listening on IPv6 address "::1", port 5432956gitlab # [ 17.322500] postgres[896]: [896] LOG: listening on IPv4 address "127.0.0.1", port 5432957gitlab # [ 17.339411] postgres[896]: [896] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"958gitlab # [ 17.365191] postgres[906]: [906] LOG: database system was shut down at 2026-09-04 07:39:50 GMT959gitlab # [ 17.381419] postgres[896]: [896] LOG: database system is ready to accept connections960gitlab # [ 17.397012] systemd[1]: Started PostgreSQL Server.961gitlab # [ 17.413797] systemd[1]: Starting PostgreSQL Setup Scripts...962gitlab # [ 17.994202] postgresql-setup-start[922]: CREATE DATABASE963gitlab # [ 18.072930] postgresql-setup-start[936]: CREATE ROLE964gitlab # [ 18.123182] postgresql-setup-start[938]: ALTER DATABASE965gitlab # [ 18.255332] postgresql-setup-start[943]: CREATE ROLE966gitlab # [ 18.260858] systemd[1]: Finished PostgreSQL Setup Scripts.967gitlab # [ 18.265853] systemd[1]: Reached target PostgreSQL.968gitlab # [ 18.275974] systemd[1]: Starting gitlab-postgresql.service...969gitlab # [ 18.599868] gitlab-postgresql-start[951]: CREATE DATABASE970gitlab # [ 18.690571] gitlab-postgresql-start[960]: CREATE EXTENSION971gitlab # [ 18.812898] dhcpcd[768]: eth0: leased 10.0.2.15 for 86400 seconds972gitlab # [ 18.813956] dhcpcd[768]: eth0: adding route to 10.0.2.0/24973gitlab # [ 18.814742] dhcpcd[768]: eth0: adding default route via 10.0.2.2974gitlab # [ 19.007979] gitlab-postgresql-start[962]: CREATE EXTENSION975gitlab # [ 19.019021] systemd[1]: Finished gitlab-postgresql.service.976gitlab # [ 19.109863] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[956]: mkdir -p /var/gitlab/state/home/.ssh: OK977gitlab # [ 19.116075] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[956]: chmod 700 /var/gitlab/state/home/.ssh: OK978gitlab # [ 19.156305] systemd[1]: Started DHCP Client.979gitlab # [ 19.158042] systemd[1]: Reached target Network is Online.980gitlab # [ 19.215993] systemd[1]: Finished gitlab-config.service.981gitlab # [ 19.227122] systemd[1]: Started gitaly.service.982gitlab # [ 19.233005] systemd[1]: Starting gitlab-db-config.service...983gitlab # [ 20.097959] gitaly[1041]: time="2026-09-04T07:39:54.682Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=1041984gitlab # [ 20.103635] gitaly[1041]: time="2026-09-04T07:39:54.683Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=1041985gitlab # [ 20.110933] gitaly[1041]: time="2026-09-04T07:39:54.683Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=1041986gitlab # [ 20.114818] gitaly[1041]: time="2026-09-04T07:39:54.685Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=1041987gitlab # [ 20.117575] gitaly[1041]: time="2026-09-04T07:39:54.685Z" level=info msg="Starting Gitaly" pid=1041 version=988gitlab # [ 20.519980] gitaly[1041]: time="2026-09-04T07:39:55.098Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=412 pid=1041989gitlab # [ 20.521742] gitaly[1041]: time="2026-09-04T07:39:55.099Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=1041990gitlab # [ 20.523208] gitaly[1041]: time="2026-09-04T07:39:55.099Z" level=info msg="finished initializing command factory" duration_ms=0 pid=1041991gitlab # [ 20.524876] gitaly[1041]: time="2026-09-04T07:39:55.099Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1041/git-exec-1157021760.d/git pid=1041992gitlab # [ 20.531068] gitaly[1041]: time="2026-09-04T07:39:55.116Z" level=info msg="finished detecting git version" duration_ms=16 pid=1041993gitlab # [ 20.540871] gitaly[1041]: time="2026-09-04T07:39:55.122Z" level=info msg="using Git version" pid=1041 version=2.53.g994gitlab # [ 20.542797] gitaly[1041]: time="2026-09-04T07:39:55.123Z" level=info msg="clearing disk cache object folder" pid=1041 storage=default995gitlab # [ 20.545343] gitaly[1041]: time="2026-09-04T07:39:55.123Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache566361488 pid=1041 storage=default996gitlab # [ 20.548647] gitaly[1041]: time="2026-09-04T07:39:55.123Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache566361488 pid=1041 storage=default997gitlab # [ 20.552471] gitaly[1041]: time="2026-09-04T07:39:55.123Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=1041998gitlab # [ 20.554742] gitaly[1041]: time="2026-09-04T07:39:55.123Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=1041999gitlab # [ 20.561228] gitaly[1041]: time="2026-09-04T07:39:55.124Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache566361488 clear_duration_ms=0 pid=1041 storage=default1000gitlab # [ 20.589407] gitaly[1041]: time="2026-09-04T07:39:55.174Z" level=info msg="counting repositories" pid=10411001gitlab # [ 20.594078] gitaly[1041]: time="2026-09-04T07:39:55.174Z" level=info msg="starting to count repositories" pid=1041 storage_path=/var/gitlab/state/repositories1002gitlab # [ 20.599586] gitaly[1041]: time="2026-09-04T07:39:55.174Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1041 storage_path=/var/gitlab/state/repositories1003gitlab # [ 20.604720] gitaly[1041]: time="2026-09-04T07:39:55.174Z" level=info msg="completed counting all repositories" counting_duration=0 pid=10411004gitlab # [ 20.612481] gitaly[1041]: time="2026-09-04T07:39:55.174Z" level=info msg="finished tempdir cleaner walk" pid=1041 storage=default time_ms=01005gitlab # [ 20.614079] gitaly[1041]: time="2026-09-04T07:39:55.175Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=10411006gitlab # [ 20.616559] gitaly[1041]: time="2026-09-04T07:39:55.175Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1041 schema=unix1007gitlab # [ 20.619172] gitaly[1041]: time="2026-09-04T07:39:55.175Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1041/sock.d/intern pid=1041 schema=unix1008gitlab # [ 20.621858] gitaly[1041]: time="2026-09-04T07:39:55.181Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=10411009gitlab # [ 20.624108] gitaly[1041]: time="2026-09-04T07:39:55.181Z" level=info msg="Started Gitaly" duration_ms=495 pid=10411010gitlab # [ 20.625959] gitaly[1041]: time="2026-09-04T07:39:55.183Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=10411011gitlab # [ 20.628085] gitaly[1041]: time="2026-09-04T07:39:55.183Z" level=info msg="maintenance: daily scheduled" pid=1041 scheduled="2026-09-04 12:00:00 +0000 UTC"1012gitlab # [ 23.252527] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1044]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1013gitlab # [ 23.253338] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1044]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1014gitlab # [ 23.355868] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1044]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1015gitlab # [ 25.660775] gitaly[1041]: time="2026-09-04T07:40:00.245Z" level=info msg="License database preloaded" duration_ms=5562 pid=10411016gitlab # [ 92.593314] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1044]: W, [2026-09-04T07:41:07.176282 #1044] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1017gitlab # [ 96.032242] gitlab-workhorse[862]: time="2026-09-04T07:41:10Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1018gitlab # [ 97.241606] postgres[1714]: [1714] ERROR: relation "feature_gates" does not exist at character 5231019gitlab # [ 97.242144] postgres[1714]: [1714] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1020gitlab # [ 97.242343] postgres[1714]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1021gitlab # [ 97.242563] postgres[1714]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1022gitlab # [ 97.242674] postgres[1714]: attidentity AS identity,1023gitlab # [ 97.242789] postgres[1714]: attgenerated as attgenerated1024gitlab # [ 97.242914] postgres[1714]: FROM pg_attribute a1025gitlab # [ 97.243087] postgres[1714]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1026gitlab # [ 97.243193] postgres[1714]: LEFT JOIN pg_type t ON a.atttypid = t.oid1027gitlab # [ 97.243308] postgres[1714]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1028gitlab # [ 97.243432] postgres[1714]: WHERE a.attrelid = '"feature_gates"'::regclass1029gitlab # [ 97.243548] postgres[1714]: AND a.attnum > 0 AND NOT a.attisdropped1030gitlab # [ 97.243655] postgres[1714]: ORDER BY a.attnum1031gitlab # [ 97.243793] postgres[1714]:1032gitlab # [ 103.234068] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1775]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1033gitlab # [ 103.236596] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1775]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1034gitlab # [ 106.040544] gitlab-workhorse[862]: time="2026-09-04T07:41:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 116.051944] gitlab-workhorse[862]: time="2026-09-04T07:41:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 126.057347] gitlab-workhorse[862]: time="2026-09-04T07:41:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1037gitlab # [ 131.551221] postgres[1881]: [1881] ERROR: relation "table_without_models" does not exist1038gitlab # [ 131.551655] postgres[1881]: [1881] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1039gitlab # [ 136.062160] gitlab-workhorse[862]: time="2026-09-04T07:41:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 146.064913] gitlab-workhorse[862]: time="2026-09-04T07:42:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 156.074746] gitlab-workhorse[862]: time="2026-09-04T07:42:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 157.500299] systemd[1]: Finished gitlab-db-config.service.1043gitlab # [ 157.506045] systemd[1]: Started gitlab-sidekiq.service.1044gitlab # [ 157.513361] systemd[1]: Starting gitlab.service...1045gitlab # [ 158.205005] bundle[2235]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1046gitlab # [ 158.205555] bundle[2235]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1047gitlab # [ 158.208096] bundle[2235]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1048gitlab # [ 164.254369] sidekiq-cluster[2233]: {"severity":"INFO","time":"2026-09-04T07:42:18.793Z","message":"Starting cluster with 1 processes"}1049gitlab # [ 164.359809] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.896Z","pid":2235,"message":"* Enabling systemd notification integration"}1050gitlab # [ 164.364923] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"Puma starting in cluster mode..."}1051gitlab # [ 164.369301] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1052gitlab # [ 164.374050] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1053gitlab # [ 164.379978] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"* Min threads: 0"}1054gitlab # [ 164.383905] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"* Max threads: 4"}1055gitlab # [ 164.388165] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"* Environment: production"}1056gitlab # [ 164.392652] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"* Master PID: 2235"}1057gitlab # [ 164.396700] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"* Workers: 2"}1058gitlab # [ 164.400869] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1059gitlab # [ 164.406501] bundle[2235]: {"timestamp":"2026-09-04T07:42:18.944Z","pid":2235,"message":"* Preloading application"}1060gitlab # [ 166.082264] gitlab-workhorse[862]: time="2026-09-04T07:42:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 176.084244] gitlab-workhorse[862]: time="2026-09-04T07:42:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 186.085595] gitlab-workhorse[862]: time="2026-09-04T07:42:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 196.086561] gitlab-workhorse[862]: time="2026-09-04T07:42:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 206.087630] gitlab-workhorse[862]: time="2026-09-04T07:43:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 210.687665] bundle[2235]: W, [2026-09-04T07:43:05.271691 #2235] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1066gitlab # [ 216.094379] gitlab-workhorse[862]: time="2026-09-04T07:43:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 216.655518] sidekiq-cluster[2292]: 2026-09-04T07:43:11.239Z pid=2292 tid=xng INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2292, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>424988672}1068gitlab # [ 217.003505] sidekiq-cluster[2292]: W, [2026-09-04T07:43:11.588854 #2292] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1069gitlab # [ 217.171062] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:11.756Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1070gitlab # [ 220.744789] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.328Z","message":"GitLab reliable fetch activated!"}1071gitlab # [ 220.745274] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.329Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1072gitlab # [ 220.781446] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.366Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1073gitlab # [ 220.788440] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.370Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1074gitlab # [ 220.795330] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.373Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1075gitlab # [ 220.801936] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.376Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1076gitlab # [ 220.809218] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.379Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1077gitlab # [ 220.816973] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.381Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1078gitlab # [ 220.823721] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.384Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1079gitlab # [ 220.830012] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.386Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1080gitlab # [ 220.836149] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.389Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1081gitlab # [ 220.841505] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.391Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1082gitlab # [ 220.847319] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.393Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1083gitlab # [ 220.852397] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.396Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1084gitlab # [ 220.856633] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.401Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1085gitlab # [ 220.860896] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.406Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1086gitlab # [ 220.864815] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.411Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1087gitlab # [ 220.868520] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.416Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1088gitlab # [ 220.871843] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.420Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1089gitlab # [ 220.875141] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.423Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1090gitlab # [ 220.878600] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.426Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1091gitlab # [ 220.881738] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.429Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1092gitlab # [ 220.885034] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.431Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1093gitlab # [ 220.888308] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.434Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1094gitlab # [ 220.891087] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.437Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1095gitlab # [ 220.893984] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.440Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1096gitlab # [ 220.896756] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.442Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1097gitlab # [ 220.899286] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.445Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1098gitlab # [ 220.901787] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.448Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1099gitlab # [ 220.904207] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.451Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1100gitlab # [ 220.906616] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.454Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1101gitlab # [ 220.909152] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.457Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1102gitlab # [ 220.911367] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.460Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1103gitlab # [ 220.913924] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.463Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1104gitlab # [ 220.916065] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.466Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1105gitlab # [ 220.918344] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.469Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1106gitlab # [ 220.920597] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.472Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1107gitlab # [ 220.922765] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.474Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1108gitlab # [ 220.924961] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.476Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1109gitlab # [ 220.926982] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.479Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1110gitlab # [ 220.929066] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.481Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1111gitlab # [ 220.931051] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.484Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1112gitlab # [ 220.933259] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.486Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1113gitlab # [ 220.935329] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.488Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1114gitlab # [ 220.937572] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.491Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1115gitlab # [ 220.939598] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.493Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1116gitlab # [ 220.941859] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.496Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1117gitlab # [ 220.944080] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.499Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1118gitlab # [ 220.946174] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.501Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1119gitlab # [ 220.948288] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.503Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1120gitlab # [ 220.950344] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.506Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1121gitlab # [ 220.952441] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.509Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1122gitlab # [ 220.954524] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.511Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1123gitlab # [ 220.956595] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.515Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1124gitlab # [ 220.958664] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.528Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1125gitlab # [ 220.961011] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.531Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1126gitlab # [ 220.963145] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.534Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1127gitlab # [ 220.965344] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.537Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1128gitlab # [ 220.967446] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.541Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1129gitlab # [ 220.969777] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.544Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1130gitlab # [ 220.971932] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.546Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1131gitlab # [ 220.974265] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.549Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1132gitlab # [ 221.052191] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.635Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1133gitlab # [ 221.058452] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.643Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1134gitlab # [ 221.065469] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.650Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1135gitlab # [ 221.072989] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.658Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1136gitlab # [ 221.081099] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.666Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1137gitlab # [ 221.090026] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.675Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1138gitlab # [ 221.096440] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.680Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1139gitlab # [ 221.103026] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.684Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1140gitlab # [ 221.109741] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.690Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1141gitlab # [ 221.115996] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.694Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1142gitlab # [ 221.121736] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.700Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1143gitlab # [ 221.126994] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.706Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1144gitlab # [ 221.132290] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.711Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1145gitlab # [ 221.137788] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.715Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1146gitlab # [ 221.142937] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.719Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1147gitlab # [ 221.147697] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.725Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1148gitlab # [ 221.151999] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.729Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1149gitlab # [ 221.156299] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.734Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1150gitlab # [ 221.159914] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.738Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1151gitlab # [ 221.163457] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.742Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1152gitlab # [ 221.167175] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.745Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1153gitlab # [ 221.170723] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.750Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1154gitlab # [ 221.173957] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.754Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1155gitlab # [ 221.176873] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.759Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1156gitlab # [ 221.179890] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.762Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1157gitlab # [ 221.182838] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.766Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1158gitlab # [ 221.185818] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.769Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1159gitlab # [ 221.188525] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.773Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1160gitlab # [ 221.191193] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.776Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1161gitlab # [ 221.193873] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.779Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1162gitlab # [ 221.197330] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.782Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1163gitlab # [ 221.200040] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.785Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1164gitlab # [ 221.203693] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.789Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1165gitlab # [ 221.206537] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.792Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1166gitlab # [ 221.211121] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.796Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1167gitlab # [ 221.214474] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.800Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1168gitlab # [ 221.218474] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.803Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1169gitlab # [ 221.223228] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.807Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1170gitlab # [ 221.231966] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.817Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1171gitlab # [ 221.235847] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.821Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1172gitlab # [ 221.239344] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.824Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1173gitlab # [ 221.243130] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.828Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1174gitlab # [ 221.247907] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.833Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1175gitlab # [ 221.251433] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.836Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1176gitlab # [ 221.255181] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.840Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1177gitlab # [ 221.258911] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.842Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1178gitlab # [ 221.262097] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.845Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1179gitlab # [ 221.265340] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.848Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1180gitlab # [ 221.268374] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:43:15.851Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1181gitlab # [ 226.095499] gitlab-workhorse[862]: time="2026-09-04T07:43:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 236.102286] gitlab-workhorse[862]: time="2026-09-04T07:43:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 246.115112] gitlab-workhorse[862]: time="2026-09-04T07:43:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 256.116447] gitlab-workhorse[862]: time="2026-09-04T07:43:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 264.000944] postgres[3120]: [3120] ERROR: relation "table_without_models" does not exist1186gitlab # [ 264.004565] postgres[3120]: [3120] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1187gitlab # [ 266.126596] gitlab-workhorse[862]: time="2026-09-04T07:44:00Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 267.516247] postgres[3149]: [3149] ERROR: relation "table_without_models" does not exist1189gitlab # [ 267.519899] postgres[3149]: [3149] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1190gitlab # [ 269.451497] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:04.036Z","message":"Booted Rails 7.2.3.1 application in production environment"}1191gitlab # [ 269.460858] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:04.046Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1192gitlab # [ 269.463768] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:04.046Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1193gitlab # [ 269.465776] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:04.048Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1194gitlab # [ 269.467778] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:04.052Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1195gitlab # [ 272.506893] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:07.091Z","message":"Cleaning working queues"}1196gitlab # [ 272.512202] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:07.096Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8ac3826be1772f185b1062c3","created_at":"2026-09-04T07:42:11.352Z","trace_propagation_headers":{"sentry-trace":"658affb450c44365867ff6e0b62c1b27-72157b5ee3784f9e","baggage":"sentry-trace_id=658affb450c44365867ff6e0b62c1b27,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cc65032f0c81719793a3331ebbbeb9b1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:11.368Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8ac3826be1772f185b1062c3: start","job_status":"start","queue_duration_s":115.727511,"scheduling_latency_s":115.727625}1197gitlab # [ 272.961804] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:07.545Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8ac3826be1772f185b1062c3","created_at":"2026-09-04T07:42:11.352Z","trace_propagation_headers":{"sentry-trace":"658affb450c44365867ff6e0b62c1b27-72157b5ee3784f9e","baggage":"sentry-trace_id=658affb450c44365867ff6e0b62c1b27,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cc65032f0c81719793a3331ebbbeb9b1","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:11.368Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8ac3826be1772f185b1062c3: done: 0.449801 sec","job_status":"done","queue_duration_s":115.727511,"scheduling_latency_s":115.727625,"redis_calls":29,"redis_duration_s":0.015304000000000002,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.00854,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004433,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002331,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.228979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.23522198,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.449801,"completed_at":"2026-09-04T07:44:07.545Z","load_balancing_strategy":"primary","db_duration_s":0.130049,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1198gitlab # [ 273.786794] bundle[2235]: {"timestamp":"2026-09-04T07:44:08.371Z","pid":2235,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1199gitlab # [ 273.787151] bundle[2235]: {"timestamp":"2026-09-04T07:44:08.371Z","pid":2235,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1200gitlab # [ 273.787342] bundle[2235]: {"timestamp":"2026-09-04T07:44:08.371Z","pid":2235,"message":"! #\u003cThread:0x0000ff75fa13f720 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1201gitlab # [ 273.787476] bundle[2235]: {"timestamp":"2026-09-04T07:44:08.371Z","pid":2235,"message":"! #\u003cThread:0x0000ff75f79b30d0 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1202gitlab # [ 273.787583] bundle[2235]: {"timestamp":"2026-09-04T07:44:08.371Z","pid":2235,"message":"Use Ctrl-C to stop"}1203gitlab # [ 273.787719] bundle[2235]: {"timestamp":"2026-09-04T07:44:08.372Z","pid":2235,"message":"Sending status to systemd every 1.0 sec"}1204gitlab # [ 274.516408] bundle[2235]: {"timestamp":"2026-09-04T07:44:09.098Z","pid":2235,"message":"- Worker 0 (PID: 3266) booted in 0.68s, phase: 0"}1205gitlab # [ 274.547409] bundle[2235]: {"timestamp":"2026-09-04T07:44:09.132Z","pid":2235,"message":"- Worker 1 (PID: 3270) booted in 0.68s, phase: 0"}1206gitlab # [ 274.554445] systemd[1]: Started gitlab.service.1207gitlab # [ 274.556766] systemd[1]: Reached target Common target for all GitLab services..1208gitlab # [ 274.562926] systemd[1]: Starting setup-gitlab.service...1209gitlab # [ 274.636949] setup-gitlab-start[3303]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1210gitlab # [ 278.569761] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:44:13 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 38681211gitlab # [ 278.575679] setup-gitlab-start[3303]: + TOKEN=nixbot-test-token-of-20-chars1212gitlab # [ 278.579104] setup-gitlab-start[3303]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1213gitlab # [ 278.597170] runuser[3334]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1214gitlab # [ 279.225838] setup-gitlab-start[3335]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1215gitlab # [ 279.232521] setup-gitlab-start[3335]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1216gitlab # [ 279.232674] setup-gitlab-start[3335]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1217gitlab # [ 280.180912] setup-gitlab-start[3335]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1218gitlab # [ 280.187472] setup-gitlab-start[3335]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1219gitlab # [ 280.194077] setup-gitlab-start[3335]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1220gitlab # [ 285.914522] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:20.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"bf6a5578952cfe0d242bd6d4","created_at":"2026-09-04T07:44:20.376Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd63a407fca3ef17a004564918329bc5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.492Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-bf6a5578952cfe0d242bd6d4: start","job_status":"start","queue_duration_s":0.004984,"scheduling_latency_s":0.005089}1221gitlab # [ 286.348977] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:20.931Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"bf6a5578952cfe0d242bd6d4","created_at":"2026-09-04T07:44:20.376Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd63a407fca3ef17a004564918329bc5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.492Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-bf6a5578952cfe0d242bd6d4: done: 0.434023 sec","job_status":"done","queue_duration_s":0.004984,"scheduling_latency_s":0.005089,"redis_calls":12,"redis_duration_s":0.06284,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005612,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.051014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006214,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0033615,"exclusive_lock_hold_duration_s":0.08877114,"duration_s":0.434023,"completed_at":"2026-09-04T07:44:20.931Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.128784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1222gitlab # [ 286.451464] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:20.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"afed8ccabccd3080ffbdd561","created_at":"2026-09-04T07:44:20.522Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4fd107f5f59fa8a21541c314a911a535","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:44:20.574Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-afed8ccabccd3080ffbdd561: start","job_status":"start","queue_duration_s":0.380125,"scheduling_latency_s":0.380227}1223gitlab # [ 286.655048] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:21.239Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1224gitlab # [ 286.709512] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:21.292Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"afed8ccabccd3080ffbdd561","created_at":"2026-09-04T07:44:20.522Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4fd107f5f59fa8a21541c314a911a535","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:44:20.574Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-afed8ccabccd3080ffbdd561: done: 0.337522 sec","job_status":"done","queue_duration_s":0.380125,"scheduling_latency_s":0.380227,"redis_calls":10,"redis_duration_s":0.016455,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004504,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002979,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0012329,"duration_s":0.337522,"completed_at":"2026-09-04T07:44:21.292Z","load_balancing_strategy":"primary","db_duration_s":0.050884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 286.786612] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:21.353Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d372af76e655622ca3dec55b","created_at":"2026-09-04T07:44:20.635Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5169c3ff12686613dc665d84c6b0cb02","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.661Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d372af76e655622ca3dec55b: start","job_status":"start","queue_duration_s":0.692191,"scheduling_latency_s":0.692313}1226gitlab # [ 287.159287] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:21.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d372af76e655622ca3dec55b","created_at":"2026-09-04T07:44:20.635Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5169c3ff12686613dc665d84c6b0cb02","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.661Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d372af76e655622ca3dec55b: done: 0.387417 sec","job_status":"done","queue_duration_s":0.692191,"scheduling_latency_s":0.692313,"redis_calls":13,"redis_duration_s":0.055774,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005713,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.037015,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.013046,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.082,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.082,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.134406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0716855,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.387417,"completed_at":"2026-09-04T07:44:21.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.081465,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1227gitlab # [ 287.262980] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:21.762Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"013e4a4832ab32741cca89c0","created_at":"2026-09-04T07:44:20.701Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"867c586724725a4f137649a0ec637b5a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.742Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-013e4a4832ab32741cca89c0: start","job_status":"start","queue_duration_s":1.019752,"scheduling_latency_s":1.019879}1228gitlab # [ 287.695898] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:22.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"013e4a4832ab32741cca89c0","created_at":"2026-09-04T07:44:20.701Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"867c586724725a4f137649a0ec637b5a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.742Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-013e4a4832ab32741cca89c0: done: 0.514818 sec","job_status":"done","queue_duration_s":1.019752,"scheduling_latency_s":1.019879,"redis_calls":10,"redis_duration_s":0.062827,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.016195,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.031899,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.014733,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00617668,"duration_s":0.514818,"completed_at":"2026-09-04T07:44:22.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037454,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 287.848308] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:22.433Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"599940561bac55da6e317d15","created_at":"2026-09-04T07:44:20.783Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec396a6513ffb3b3184e28a61702756c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.815Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-599940561bac55da6e317d15: start","job_status":"start","queue_duration_s":1.617875,"scheduling_latency_s":1.617937}1230gitlab # [ 290.279756] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:24.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"599940561bac55da6e317d15","created_at":"2026-09-04T07:44:20.783Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec396a6513ffb3b3184e28a61702756c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.815Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-599940561bac55da6e317d15: done: 2.426146 sec","job_status":"done","queue_duration_s":1.617875,"scheduling_latency_s":1.617937,"redis_calls":12,"redis_duration_s":0.114999,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.030484,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.048171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.036344,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.231,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.231,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.301362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.01417788,"exclusive_lock_hold_duration_s":1.44077664,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":2.426146,"completed_at":"2026-09-04T07:44:24.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.501927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 290.388180] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:24.972Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"98b7bbe40fd7a7868a8b8da0","created_at":"2026-09-04T07:44:20.898Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5bbe61ed829b8cbcb87b20970df3374","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.940Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-98b7bbe40fd7a7868a8b8da0: start","job_status":"start","queue_duration_s":4.032095,"scheduling_latency_s":4.032145}1232gitlab # [ 290.716628] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:25.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"98b7bbe40fd7a7868a8b8da0","created_at":"2026-09-04T07:44:20.898Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5bbe61ed829b8cbcb87b20970df3374","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:20.940Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-98b7bbe40fd7a7868a8b8da0: done: 0.327149 sec","job_status":"done","queue_duration_s":4.032095,"scheduling_latency_s":4.032145,"redis_calls":12,"redis_duration_s":0.073492,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.037133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.028872,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00463562,"exclusive_lock_hold_duration_s":0.05814494,"duration_s":0.327149,"completed_at":"2026-09-04T07:44:25.299Z","load_balancing_strategy":"primary","db_duration_s":0.030165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 290.819193] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:25.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6a4d1567a272a28b8f1bc5d4","created_at":"2026-09-04T07:44:21.047Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b29920ad1d6e8ac4e4988596fdbf1e9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.065Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6a4d1567a272a28b8f1bc5d4: start","job_status":"start","queue_duration_s":4.336044,"scheduling_latency_s":4.33697}1234gitlab # [ 291.065587] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:25.648Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6a4d1567a272a28b8f1bc5d4","created_at":"2026-09-04T07:44:21.047Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b29920ad1d6e8ac4e4988596fdbf1e9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.065Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6a4d1567a272a28b8f1bc5d4: done: 0.247272 sec","job_status":"done","queue_duration_s":4.336044,"scheduling_latency_s":4.33697,"redis_calls":12,"redis_duration_s":0.025052,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.006568,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014881,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003603,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00107264,"duration_s":0.247272,"completed_at":"2026-09-04T07:44:25.648Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 291.174492] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:25.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"15a6f4e45ceaa03041eaca54","created_at":"2026-09-04T07:44:21.083Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.118Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-15a6f4e45ceaa03041eaca54: start","job_status":"start","queue_duration_s":4.639864,"scheduling_latency_s":4.639946}1236gitlab # [ 292.222130] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:26.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"15a6f4e45ceaa03041eaca54","created_at":"2026-09-04T07:44:21.083Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.118Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-15a6f4e45ceaa03041eaca54: done: 1.047465 sec","job_status":"done","queue_duration_s":4.639864,"scheduling_latency_s":4.639946,"redis_calls":71,"redis_duration_s":0.278642,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.056514,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.004433,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.205073,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.012622,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.062,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.450527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00421954,"duration_s":1.047465,"completed_at":"2026-09-04T07:44:26.804Z","load_balancing_strategy":"primary","db_duration_s":0.062178,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 292.321200] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:26.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"e80ab0016347964ec73940ef","created_at":"2026-09-04T07:44:21.234Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.300Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-e80ab0016347964ec73940ef: start","job_status":"start","queue_duration_s":5.605727,"scheduling_latency_s":5.605785}1238gitlab # [ 292.795425] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:27.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"e80ab0016347964ec73940ef","created_at":"2026-09-04T07:44:21.234Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.300Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-e80ab0016347964ec73940ef: done: 0.473628 sec","job_status":"done","queue_duration_s":5.605727,"scheduling_latency_s":5.605785,"redis_calls":28,"redis_duration_s":0.075228,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.0091,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.004048,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.047568,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.014512,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.268161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0022558,"duration_s":0.473628,"completed_at":"2026-09-04T07:44:27.379Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 292.900337] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:27.484Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2dee6cd366a2811673bebccd","created_at":"2026-09-04T07:44:21.377Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"552dc7e3d92623e681e2cb3ad77b28b5","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.409Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2dee6cd366a2811673bebccd: start","job_status":"start","queue_duration_s":6.075676,"scheduling_latency_s":6.075736}1240gitlab # [ 293.061910] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:27.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2dee6cd366a2811673bebccd","created_at":"2026-09-04T07:44:21.377Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"552dc7e3d92623e681e2cb3ad77b28b5","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.409Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2dee6cd366a2811673bebccd: done: 0.161257 sec","job_status":"done","queue_duration_s":6.075676,"scheduling_latency_s":6.075736,"redis_calls":12,"redis_duration_s":0.02195,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002985,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012248,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006717,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00239196,"exclusive_lock_hold_duration_s":0.0121329,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.161257,"completed_at":"2026-09-04T07:44:27.645Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 293.176603] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:27.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b0e35f3dc2744a025ee3c1ff","created_at":"2026-09-04T07:44:21.539Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c5162f10117e868244294f3a57cd8f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:44:21.607Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b0e35f3dc2744a025ee3c1ff: start","job_status":"start","queue_duration_s":6.096073,"scheduling_latency_s":6.096114}1242gitlab # [ 293.327904] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:27.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b0e35f3dc2744a025ee3c1ff","created_at":"2026-09-04T07:44:21.539Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c5162f10117e868244294f3a57cd8f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:44:21.607Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b0e35f3dc2744a025ee3c1ff: done: 0.204733 sec","job_status":"done","queue_duration_s":6.096073,"scheduling_latency_s":6.096114,"redis_calls":10,"redis_duration_s":0.019717,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002774,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012596,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004347,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00349642,"duration_s":0.204733,"completed_at":"2026-09-04T07:44:27.908Z","load_balancing_strategy":"primary","db_duration_s":0.031262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 293.414976] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:27.918Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e6f4c135f445a066e8e10129","created_at":"2026-09-04T07:44:21.656Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28b50f103e0f6ec558dd9029f0b9198a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.706Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e6f4c135f445a066e8e10129: start","job_status":"start","queue_duration_s":6.212503,"scheduling_latency_s":6.212567}1244gitlab # [ 293.432533] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:27.986Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1245gitlab # [ 293.441587] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:28.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e6f4c135f445a066e8e10129","created_at":"2026-09-04T07:44:21.656Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28b50f103e0f6ec558dd9029f0b9198a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.706Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e6f4c135f445a066e8e10129: done: 0.107227 sec","job_status":"done","queue_duration_s":6.212503,"scheduling_latency_s":6.212567,"redis_calls":10,"redis_duration_s":0.006022,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000899,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004089,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00087632,"duration_s":0.107227,"completed_at":"2026-09-04T07:44:28.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 293.492992] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:28.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"308c96e6b10823b91253c282","created_at":"2026-09-04T07:44:21.744Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.788Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-308c96e6b10823b91253c282: start","job_status":"start","queue_duration_s":6.242681,"scheduling_latency_s":6.242739}1247gitlab # [ 293.608385] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:28.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"308c96e6b10823b91253c282","created_at":"2026-09-04T07:44:21.744Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.788Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-308c96e6b10823b91253c282: done: 0.160592 sec","job_status":"done","queue_duration_s":6.242681,"scheduling_latency_s":6.242739,"redis_calls":19,"redis_duration_s":0.036329,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00644,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.003319,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.018883,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.007687,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00361486,"duration_s":0.160592,"completed_at":"2026-09-04T07:44:28.191Z","load_balancing_strategy":"primary","db_duration_s":0.016747,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 293.672464] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:28.211Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"abffe5c986b17ae0907687ef","created_at":"2026-09-04T07:44:21.820Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46293ce9ca4f2b84ad3abb56b984eb47","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.848Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-abffe5c986b17ae0907687ef: start","job_status":"start","queue_duration_s":6.362103,"scheduling_latency_s":6.362168}1249gitlab # [ 296.224181] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"abffe5c986b17ae0907687ef","created_at":"2026-09-04T07:44:21.820Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46293ce9ca4f2b84ad3abb56b984eb47","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:21.848Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-abffe5c986b17ae0907687ef: done: 2.59692 sec","job_status":"done","queue_duration_s":6.362103,"scheduling_latency_s":6.362168,"redis_calls":565,"redis_duration_s":1.63342,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003748,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010913,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.618759,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.069142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058786,"duration_s":2.59692,"completed_at":"2026-09-04T07:44:30.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 296.327662] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f02dfad3c2915475db777c84","created_at":"2026-09-04T07:44:21.954Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fcc00c7505c7bb2026282f0fefc87bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:22.031Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f02dfad3c2915475db777c84: start","job_status":"start","queue_duration_s":8.778979,"scheduling_latency_s":8.779019}1251gitlab # [ 296.327859] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.833Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1252gitlab # [ 296.327984] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f02dfad3c2915475db777c84","created_at":"2026-09-04T07:44:21.954Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fcc00c7505c7bb2026282f0fefc87bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:22.031Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f02dfad3c2915475db777c84: done: 0.034992 sec","job_status":"done","queue_duration_s":8.778979,"scheduling_latency_s":8.779019,"redis_calls":10,"redis_duration_s":0.0034920000000000003,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000853,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001935,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000704,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056124,"duration_s":0.034992,"completed_at":"2026-09-04T07:44:30.845Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 296.997629] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ca761ebf86bb5e1b3e6d1661","created_at":"2026-09-04T07:44:22.223Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e26251cc836b25f9c2d48880c250fcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:44:22.344Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ca761ebf86bb5e1b3e6d1661: start","job_status":"start","queue_duration_s":8.503337,"scheduling_latency_s":8.503371}1254gitlab # [ 296.997736] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.864Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1255gitlab # [ 296.997814] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ca761ebf86bb5e1b3e6d1661","created_at":"2026-09-04T07:44:22.223Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e26251cc836b25f9c2d48880c250fcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:44:22.344Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ca761ebf86bb5e1b3e6d1661: done: 0.024374 sec","job_status":"done","queue_duration_s":8.503337,"scheduling_latency_s":8.503371,"redis_calls":10,"redis_duration_s":0.002717,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000656,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000547,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038544,"duration_s":0.024374,"completed_at":"2026-09-04T07:44:30.872Z","load_balancing_strategy":"primary","db_duration_s":0.000808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 297.723654] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e28e64e18fe1636d487a2bfb","created_at":"2026-09-04T07:44:22.509Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55fd14bb852438412f3a5274d4584ede","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:22.605Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e28e64e18fe1636d487a2bfb: start","job_status":"start","queue_duration_s":8.268636,"scheduling_latency_s":8.268656}1257gitlab # [ 297.723778] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.897Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e28e64e18fe1636d487a2bfb","created_at":"2026-09-04T07:44:22.509Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55fd14bb852438412f3a5274d4584ede","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:22.605Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e28e64e18fe1636d487a2bfb: done: 0.022962 sec","job_status":"done","queue_duration_s":8.268636,"scheduling_latency_s":8.268656,"redis_calls":10,"redis_duration_s":0.002681,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000652,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037064,"duration_s":0.022962,"completed_at":"2026-09-04T07:44:30.897Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 298.428195] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:30.899Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e1bc50c7319c58942dc849cd","created_at":"2026-09-04T07:44:22.691Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cec6e7449565a25405b8adf82c32e912","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:22.805Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e1bc50c7319c58942dc849cd: start","job_status":"start","queue_duration_s":8.093397,"scheduling_latency_s":8.093418}1259gitlab # [ 298.453706] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.211Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e1bc50c7319c58942dc849cd","created_at":"2026-09-04T07:44:22.691Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cec6e7449565a25405b8adf82c32e912","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:22.805Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e1bc50c7319c58942dc849cd: done: 0.312575 sec","job_status":"done","queue_duration_s":8.093397,"scheduling_latency_s":8.093418,"redis_calls":14,"redis_duration_s":0.0043619999999999996,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001297,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001572,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001493,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.241818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00106562,"exclusive_lock_hold_duration_s":0.28261522,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.312575,"completed_at":"2026-09-04T07:44:31.211Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 298.513633] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c55e6ce499e317e1da9463d4","created_at":"2026-09-04T07:44:22.924Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5acdd0ba040cd860d97a239c5da4e334","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.063Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c55e6ce499e317e1da9463d4: start","job_status":"start","queue_duration_s":8.150218,"scheduling_latency_s":8.150246}1261gitlab # [ 298.528898] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c55e6ce499e317e1da9463d4","created_at":"2026-09-04T07:44:22.924Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5acdd0ba040cd860d97a239c5da4e334","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.063Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c55e6ce499e317e1da9463d4: done: 0.03811 sec","job_status":"done","queue_duration_s":8.150218,"scheduling_latency_s":8.150246,"redis_calls":10,"redis_duration_s":0.003244,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000644,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000704,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051032,"duration_s":0.03811,"completed_at":"2026-09-04T07:44:31.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 298.571283] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"84e9e76f729b3d9de3fd1f8e","created_at":"2026-09-04T07:44:23.159Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d9a83524121f98d23356b015cddc40f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.279Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-84e9e76f729b3d9de3fd1f8e: start","job_status":"start","queue_duration_s":7.974301,"scheduling_latency_s":7.974333}1263gitlab # [ 298.587152] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"84e9e76f729b3d9de3fd1f8e","created_at":"2026-09-04T07:44:23.159Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d9a83524121f98d23356b015cddc40f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.279Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-84e9e76f729b3d9de3fd1f8e: done: 0.166245 sec","job_status":"done","queue_duration_s":7.974301,"scheduling_latency_s":7.974333,"redis_calls":14,"redis_duration_s":0.005237,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001432,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002016,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001789,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.127052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00091706,"exclusive_lock_hold_duration_s":0.13360086000000002,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.166245,"completed_at":"2026-09-04T07:44:31.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.116916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 298.632212] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.422Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6f87e7feff3f0ee9ff68c3a3","created_at":"2026-09-04T07:44:23.444Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e48607e6e18bbdac1069de720e615c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.558Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6f87e7feff3f0ee9ff68c3a3: start","job_status":"start","queue_duration_s":7.86427,"scheduling_latency_s":7.864301}1265gitlab # [ 298.646590] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.439Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1266gitlab # [ 298.650264] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6f87e7feff3f0ee9ff68c3a3","created_at":"2026-09-04T07:44:23.444Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e48607e6e18bbdac1069de720e615c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.558Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6f87e7feff3f0ee9ff68c3a3: done: 0.027459 sec","job_status":"done","queue_duration_s":7.86427,"scheduling_latency_s":7.864301,"redis_calls":10,"redis_duration_s":0.0030600000000000002,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000744,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000631,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039548,"duration_s":0.027459,"completed_at":"2026-09-04T07:44:31.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000985,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 298.692597] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.451Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3a7e57f889f0aa2e49f9a356","created_at":"2026-09-04T07:44:23.645Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4669d5d3731303ab7d182f642c826324","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.770Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3a7e57f889f0aa2e49f9a356: start","job_status":"start","queue_duration_s":7.681498,"scheduling_latency_s":7.681526}1268gitlab # [ 298.706608] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3a7e57f889f0aa2e49f9a356","created_at":"2026-09-04T07:44:23.645Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4669d5d3731303ab7d182f642c826324","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.770Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3a7e57f889f0aa2e49f9a356: done: 0.04915 sec","job_status":"done","queue_duration_s":7.681498,"scheduling_latency_s":7.681526,"redis_calls":16,"redis_duration_s":0.005444,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003033,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00174,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036844,"duration_s":0.04915,"completed_at":"2026-09-04T07:44:31.500Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010116,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 298.749947] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.502Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"1476868fd387c453c9ce4722","created_at":"2026-09-04T07:44:23.829Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"f0f299f4e1c431c9f1f75a104d84f549","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.927Z","job_size_bytes":3,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-1476868fd387c453c9ce4722: start","job_status":"start","queue_duration_s":7.575621,"scheduling_latency_s":7.575641}1270gitlab # [ 298.791752] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.525Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"1476868fd387c453c9ce4722","created_at":"2026-09-04T07:44:23.829Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"f0f299f4e1c431c9f1f75a104d84f549","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:23.927Z","job_size_bytes":3,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-1476868fd387c453c9ce4722: done: 0.022461 sec","job_status":"done","queue_duration_s":7.575621,"scheduling_latency_s":7.575641,"redis_calls":10,"redis_duration_s":0.00259,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035438,"duration_s":0.022461,"completed_at":"2026-09-04T07:44:31.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 298.868096] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.527Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"45dfdb847b7fe92aa7066583","created_at":"2026-09-04T07:44:24.032Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"741fbabd7005037ccfd1318582aaaf65","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:24.157Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-45dfdb847b7fe92aa7066583: start","job_status":"start","queue_duration_s":7.369981,"scheduling_latency_s":7.37}1272gitlab # [ 298.883149] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.572Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"45dfdb847b7fe92aa7066583","created_at":"2026-09-04T07:44:24.032Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"741fbabd7005037ccfd1318582aaaf65","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:24.157Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-45dfdb847b7fe92aa7066583: done: 0.045039 sec","job_status":"done","queue_duration_s":7.369981,"scheduling_latency_s":7.37,"redis_calls":12,"redis_duration_s":0.005157,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.001369,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000911,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000799,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00079316,"duration_s":0.045039,"completed_at":"2026-09-04T07:44:31.571Z","load_balancing_strategy":"primary","db_duration_s":0.000744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 298.925908] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0937a84d9c9ba4c6aca670b2","created_at":"2026-09-04T07:44:24.252Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca24824c09cb6bdf4ba1a4c9bd722bba","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:24.369Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0937a84d9c9ba4c6aca670b2: start","job_status":"start","queue_duration_s":7.207133,"scheduling_latency_s":7.207185}1274gitlab # [ 298.940140] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0937a84d9c9ba4c6aca670b2","created_at":"2026-09-04T07:44:24.252Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca24824c09cb6bdf4ba1a4c9bd722bba","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:24.369Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0937a84d9c9ba4c6aca670b2: done: 0.07768 sec","job_status":"done","queue_duration_s":7.207133,"scheduling_latency_s":7.207185,"redis_calls":10,"redis_duration_s":0.004046,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002515,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00103012,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.07768,"completed_at":"2026-09-04T07:44:31.653Z","load_balancing_strategy":"primary","db_duration_s":0.01621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 298.982285] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.657Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"864f973582f420db1e989493","created_at":"2026-09-04T07:44:24.482Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72867379fc7ddf2769c97d346b769c01","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:24.636Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-864f973582f420db1e989493: start","job_status":"start","queue_duration_s":7.0209,"scheduling_latency_s":7.02095}1276gitlab # [ 298.997951] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.683Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1277gitlab # [ 299.001813] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"864f973582f420db1e989493","created_at":"2026-09-04T07:44:24.482Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72867379fc7ddf2769c97d346b769c01","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:24.636Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-864f973582f420db1e989493: done: 0.043195 sec","job_status":"done","queue_duration_s":7.0209,"scheduling_latency_s":7.02095,"redis_calls":10,"redis_duration_s":0.00373,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000861,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000752,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055856,"duration_s":0.043195,"completed_at":"2026-09-04T07:44:31.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 299.043372] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7200d0efc20097b286c05bc1","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7200d0efc20097b286c05bc1: start","job_status":"start","queue_duration_s":4.949218,"scheduling_latency_s":4.949257}1279gitlab # [ 299.055650] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7200d0efc20097b286c05bc1","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7200d0efc20097b286c05bc1: done: 0.04052 sec","job_status":"done","queue_duration_s":4.949218,"scheduling_latency_s":4.949257,"redis_calls":16,"redis_duration_s":0.009754,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000615,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003048,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046374,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04052,"completed_at":"2026-09-04T07:44:31.743Z","load_balancing_strategy":"primary","db_duration_s":0.00077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 299.096298] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e7ab2d5e14017e9f12b53e1","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e7ab2d5e14017e9f12b53e1: start","job_status":"start","queue_duration_s":4.991984,"scheduling_latency_s":4.992018}1281gitlab # [ 299.108612] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e7ab2d5e14017e9f12b53e1","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e7ab2d5e14017e9f12b53e1: done: 0.025778 sec","job_status":"done","queue_duration_s":4.991984,"scheduling_latency_s":4.992018,"redis_calls":13,"redis_duration_s":0.003439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025778,"completed_at":"2026-09-04T07:44:31.771Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 299.147229] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddd5c54b69ee86a8fe556095","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddd5c54b69ee86a8fe556095: start","job_status":"start","queue_duration_s":5.020515,"scheduling_latency_s":5.020547}1283gitlab # [ 299.159641] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddd5c54b69ee86a8fe556095","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddd5c54b69ee86a8fe556095: done: 0.022545 sec","job_status":"done","queue_duration_s":5.020515,"scheduling_latency_s":5.020547,"redis_calls":13,"redis_duration_s":0.003146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022545,"completed_at":"2026-09-04T07:44:31.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 299.199287] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeeff810a18c8d6a2b51f13b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeeff810a18c8d6a2b51f13b: start","job_status":"start","queue_duration_s":5.045148,"scheduling_latency_s":5.045178}1285gitlab # [ 299.211687] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeeff810a18c8d6a2b51f13b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeeff810a18c8d6a2b51f13b: done: 0.024522 sec","job_status":"done","queue_duration_s":5.045148,"scheduling_latency_s":5.045178,"redis_calls":13,"redis_duration_s":0.003445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001249,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024522,"completed_at":"2026-09-04T07:44:31.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 299.250520] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b229faa190229e76a3b5339f","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b229faa190229e76a3b5339f: start","job_status":"start","queue_duration_s":5.071548,"scheduling_latency_s":5.071577}1287gitlab # [ 299.262880] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b229faa190229e76a3b5339f","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b229faa190229e76a3b5339f: done: 0.020525 sec","job_status":"done","queue_duration_s":5.071548,"scheduling_latency_s":5.071577,"redis_calls":13,"redis_duration_s":0.003083,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00203,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020525,"completed_at":"2026-09-04T07:44:31.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 299.301441] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95742ee75cef0b3e9f02ccac","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95742ee75cef0b3e9f02ccac: start","job_status":"start","queue_duration_s":5.094915,"scheduling_latency_s":5.094945}1289gitlab # [ 299.313728] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95742ee75cef0b3e9f02ccac","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95742ee75cef0b3e9f02ccac: done: 0.021367 sec","job_status":"done","queue_duration_s":5.094915,"scheduling_latency_s":5.094945,"redis_calls":13,"redis_duration_s":0.00328,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021367,"completed_at":"2026-09-04T07:44:31.870Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 299.351943] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d610f64c38760c3d5ec5deb0","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d610f64c38760c3d5ec5deb0: start","job_status":"start","queue_duration_s":5.118153,"scheduling_latency_s":5.118179}1291gitlab # [ 299.364441] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d610f64c38760c3d5ec5deb0","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d610f64c38760c3d5ec5deb0: done: 0.019366 sec","job_status":"done","queue_duration_s":5.118153,"scheduling_latency_s":5.118179,"redis_calls":13,"redis_duration_s":0.003026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019366,"completed_at":"2026-09-04T07:44:31.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 299.404417] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f22099f9d437424574399c30","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f22099f9d437424574399c30: start","job_status":"start","queue_duration_s":5.139103,"scheduling_latency_s":5.139129}1293gitlab # [ 299.416624] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f22099f9d437424574399c30","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f22099f9d437424574399c30: done: 0.017875 sec","job_status":"done","queue_duration_s":5.139103,"scheduling_latency_s":5.139129,"redis_calls":13,"redis_duration_s":0.0029449999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017875,"completed_at":"2026-09-04T07:44:31.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 299.455250] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"226a6137a52b4f8587951421","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-226a6137a52b4f8587951421: start","job_status":"start","queue_duration_s":5.158632,"scheduling_latency_s":5.158658}1295gitlab # [ 299.467645] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"226a6137a52b4f8587951421","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-226a6137a52b4f8587951421: done: 0.018382 sec","job_status":"done","queue_duration_s":5.158632,"scheduling_latency_s":5.158658,"redis_calls":13,"redis_duration_s":0.0030629999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018382,"completed_at":"2026-09-04T07:44:31.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 299.506585] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66853d3287a3e3da79ec0c0a","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66853d3287a3e3da79ec0c0a: start","job_status":"start","queue_duration_s":5.17969,"scheduling_latency_s":5.179716}1297gitlab # [ 299.518990] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66853d3287a3e3da79ec0c0a","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66853d3287a3e3da79ec0c0a: done: 0.02068 sec","job_status":"done","queue_duration_s":5.17969,"scheduling_latency_s":5.179716,"redis_calls":13,"redis_duration_s":0.0037870000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02068,"completed_at":"2026-09-04T07:44:31.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 299.557998] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71e55e0d284b8ca58768e439","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71e55e0d284b8ca58768e439: start","job_status":"start","queue_duration_s":5.202037,"scheduling_latency_s":5.202065}1299gitlab # [ 299.570369] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71e55e0d284b8ca58768e439","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71e55e0d284b8ca58768e439: done: 0.018752 sec","job_status":"done","queue_duration_s":5.202037,"scheduling_latency_s":5.202065,"redis_calls":13,"redis_duration_s":0.0020670000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018752,"completed_at":"2026-09-04T07:44:31.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 299.611000] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c54d7c90347e7c3e64beab31","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c54d7c90347e7c3e64beab31: start","job_status":"start","queue_duration_s":5.222844,"scheduling_latency_s":5.222873}1301gitlab # [ 299.623414] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c54d7c90347e7c3e64beab31","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c54d7c90347e7c3e64beab31: done: 0.018116 sec","job_status":"done","queue_duration_s":5.222844,"scheduling_latency_s":5.222873,"redis_calls":13,"redis_duration_s":0.001906,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018116,"completed_at":"2026-09-04T07:44:31.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 299.662140] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:31.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7929c6c602b367fff15a6fc","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7929c6c602b367fff15a6fc: start","job_status":"start","queue_duration_s":5.243607,"scheduling_latency_s":5.243634}1303gitlab # [ 299.674549] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7929c6c602b367fff15a6fc","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7929c6c602b367fff15a6fc: done: 0.019603 sec","job_status":"done","queue_duration_s":5.243607,"scheduling_latency_s":5.243634,"redis_calls":13,"redis_duration_s":0.0032900000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019603,"completed_at":"2026-09-04T07:44:32.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 299.713785] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbe89d4eaa8a713991ea30b2","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbe89d4eaa8a713991ea30b2: start","job_status":"start","queue_duration_s":5.264938,"scheduling_latency_s":5.264986}1305gitlab # [ 299.726225] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbe89d4eaa8a713991ea30b2","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbe89d4eaa8a713991ea30b2: done: 0.020021 sec","job_status":"done","queue_duration_s":5.264938,"scheduling_latency_s":5.264986,"redis_calls":13,"redis_duration_s":0.0034360000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001389,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020021,"completed_at":"2026-09-04T07:44:32.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 299.765622] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a38457b0d5f6dbcc29e8e1a4","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a38457b0d5f6dbcc29e8e1a4: start","job_status":"start","queue_duration_s":5.286926,"scheduling_latency_s":5.286955}1307gitlab # [ 299.777993] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a38457b0d5f6dbcc29e8e1a4","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a38457b0d5f6dbcc29e8e1a4: done: 0.018925 sec","job_status":"done","queue_duration_s":5.286926,"scheduling_latency_s":5.286955,"redis_calls":13,"redis_duration_s":0.003203,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018925,"completed_at":"2026-09-04T07:44:32.059Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 299.817739] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d6ad412d7d386bc713f6027","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d6ad412d7d386bc713f6027: start","job_status":"start","queue_duration_s":5.308622,"scheduling_latency_s":5.308649}1309gitlab # [ 299.830200] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d6ad412d7d386bc713f6027","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d6ad412d7d386bc713f6027: done: 0.017907 sec","job_status":"done","queue_duration_s":5.308622,"scheduling_latency_s":5.308649,"redis_calls":13,"redis_duration_s":0.0038650000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001825,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017907,"completed_at":"2026-09-04T07:44:32.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 299.869099] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6773975e37614cd2a1f0b76d","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6773975e37614cd2a1f0b76d: start","job_status":"start","queue_duration_s":5.328136,"scheduling_latency_s":5.328154}1311gitlab # [ 299.881425] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6773975e37614cd2a1f0b76d","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6773975e37614cd2a1f0b76d: done: 0.018043 sec","job_status":"done","queue_duration_s":5.328136,"scheduling_latency_s":5.328154,"redis_calls":13,"redis_duration_s":0.0031070000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018043,"completed_at":"2026-09-04T07:44:32.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 299.920403] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8846306d9e7ac92305530715","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8846306d9e7ac92305530715: start","job_status":"start","queue_duration_s":5.347894,"scheduling_latency_s":5.347913}1313gitlab # [ 299.932534] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8846306d9e7ac92305530715","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8846306d9e7ac92305530715: done: 0.017958 sec","job_status":"done","queue_duration_s":5.347894,"scheduling_latency_s":5.347913,"redis_calls":13,"redis_duration_s":0.0031070000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017958,"completed_at":"2026-09-04T07:44:32.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 299.971152] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d7f6a9cec1f15d5c66bc780","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d7f6a9cec1f15d5c66bc780: start","job_status":"start","queue_duration_s":5.367655,"scheduling_latency_s":5.367674}1315gitlab # [ 299.983512] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d7f6a9cec1f15d5c66bc780","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d7f6a9cec1f15d5c66bc780: done: 0.019528 sec","job_status":"done","queue_duration_s":5.367655,"scheduling_latency_s":5.367674,"redis_calls":13,"redis_duration_s":0.003138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019528,"completed_at":"2026-09-04T07:44:32.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 300.023653] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ba3dc5216e829cad9e65ec5","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ba3dc5216e829cad9e65ec5: start","job_status":"start","queue_duration_s":5.388909,"scheduling_latency_s":5.388929}1317gitlab # [ 300.036216] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ba3dc5216e829cad9e65ec5","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ba3dc5216e829cad9e65ec5: done: 0.018574 sec","job_status":"done","queue_duration_s":5.388909,"scheduling_latency_s":5.388929,"redis_calls":13,"redis_duration_s":0.002988,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018574,"completed_at":"2026-09-04T07:44:32.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 300.075013] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"647c688afd2b04190e0ea2ae","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-647c688afd2b04190e0ea2ae: start","job_status":"start","queue_duration_s":5.409053,"scheduling_latency_s":5.409071}1319gitlab # [ 300.087420] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"647c688afd2b04190e0ea2ae","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-647c688afd2b04190e0ea2ae: done: 0.018722 sec","job_status":"done","queue_duration_s":5.409053,"scheduling_latency_s":5.409071,"redis_calls":13,"redis_duration_s":0.003515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001679,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018722,"completed_at":"2026-09-04T07:44:32.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 300.126629] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df90584d84b6f3141d0d5b60","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df90584d84b6f3141d0d5b60: start","job_status":"start","queue_duration_s":5.42965,"scheduling_latency_s":5.429671}1321gitlab # [ 300.139076] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df90584d84b6f3141d0d5b60","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df90584d84b6f3141d0d5b60: done: 0.018161 sec","job_status":"done","queue_duration_s":5.42965,"scheduling_latency_s":5.429671,"redis_calls":13,"redis_duration_s":0.00324,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018161,"completed_at":"2026-09-04T07:44:32.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 300.177835] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6beb73ffdc0ba9aa8d668390","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6beb73ffdc0ba9aa8d668390: start","job_status":"start","queue_duration_s":5.450184,"scheduling_latency_s":5.450205}1323gitlab # [ 300.190209] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6beb73ffdc0ba9aa8d668390","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6beb73ffdc0ba9aa8d668390: done: 0.018364 sec","job_status":"done","queue_duration_s":5.450184,"scheduling_latency_s":5.450205,"redis_calls":13,"redis_duration_s":0.0034000000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002278,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018364,"completed_at":"2026-09-04T07:44:32.222Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 300.229968] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2133b14df3633bb18a53d5b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2133b14df3633bb18a53d5b: start","job_status":"start","queue_duration_s":5.469802,"scheduling_latency_s":5.469822}1325gitlab # [ 300.242262] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2133b14df3633bb18a53d5b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2133b14df3633bb18a53d5b: done: 0.016288 sec","job_status":"done","queue_duration_s":5.469802,"scheduling_latency_s":5.469822,"redis_calls":13,"redis_duration_s":0.001612,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016288,"completed_at":"2026-09-04T07:44:32.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 300.281008] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"073579e5ba38c4b1b5643fb8","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-073579e5ba38c4b1b5643fb8: start","job_status":"start","queue_duration_s":5.487486,"scheduling_latency_s":5.487508}1327gitlab # [ 300.293331] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"073579e5ba38c4b1b5643fb8","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-073579e5ba38c4b1b5643fb8: done: 0.01727 sec","job_status":"done","queue_duration_s":5.487486,"scheduling_latency_s":5.487508,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01727,"completed_at":"2026-09-04T07:44:32.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 300.332396] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f887cde1aac5b6c8ff79596","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f887cde1aac5b6c8ff79596: start","job_status":"start","queue_duration_s":5.506094,"scheduling_latency_s":5.506114}1329gitlab # [ 300.344512] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f887cde1aac5b6c8ff79596","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f887cde1aac5b6c8ff79596: done: 0.016367 sec","job_status":"done","queue_duration_s":5.506094,"scheduling_latency_s":5.506114,"redis_calls":13,"redis_duration_s":0.0016319999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016367,"completed_at":"2026-09-04T07:44:32.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 300.383204] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9569c81034ac3ce37ba1bd1b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9569c81034ac3ce37ba1bd1b: start","job_status":"start","queue_duration_s":5.52391,"scheduling_latency_s":5.523931}1331gitlab # [ 300.395601] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9569c81034ac3ce37ba1bd1b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9569c81034ac3ce37ba1bd1b: done: 0.016869 sec","job_status":"done","queue_duration_s":5.52391,"scheduling_latency_s":5.523931,"redis_calls":13,"redis_duration_s":0.0017360000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016869,"completed_at":"2026-09-04T07:44:32.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 300.435702] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"961554ce80bd42cc964e4548","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-961554ce80bd42cc964e4548: start","job_status":"start","queue_duration_s":5.542233,"scheduling_latency_s":5.542256}1333gitlab # [ 300.447971] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"961554ce80bd42cc964e4548","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-961554ce80bd42cc964e4548: done: 0.016541 sec","job_status":"done","queue_duration_s":5.542233,"scheduling_latency_s":5.542256,"redis_calls":13,"redis_duration_s":0.001932,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001254,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016541,"completed_at":"2026-09-04T07:44:32.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 300.486692] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55cc7ef50814afd34e3ec9e3","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55cc7ef50814afd34e3ec9e3: start","job_status":"start","queue_duration_s":5.560304,"scheduling_latency_s":5.560324}1335gitlab # [ 300.499034] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55cc7ef50814afd34e3ec9e3","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55cc7ef50814afd34e3ec9e3: done: 0.01911 sec","job_status":"done","queue_duration_s":5.560304,"scheduling_latency_s":5.560324,"redis_calls":13,"redis_duration_s":0.003276,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001202,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01911,"completed_at":"2026-09-04T07:44:32.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 300.537640] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8b9a19c924b66f3e1080807","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8b9a19c924b66f3e1080807: start","job_status":"start","queue_duration_s":5.581452,"scheduling_latency_s":5.581472}1337gitlab # [ 300.550488] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8b9a19c924b66f3e1080807","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8b9a19c924b66f3e1080807: done: 0.017983 sec","job_status":"done","queue_duration_s":5.581452,"scheduling_latency_s":5.581472,"redis_calls":13,"redis_duration_s":0.0029490000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017983,"completed_at":"2026-09-04T07:44:32.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 300.589978] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6664c9c08bcf57df773c2f56","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6664c9c08bcf57df773c2f56: start","job_status":"start","queue_duration_s":5.601343,"scheduling_latency_s":5.601365}1339gitlab # [ 300.602432] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6664c9c08bcf57df773c2f56","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6664c9c08bcf57df773c2f56: done: 0.018969 sec","job_status":"done","queue_duration_s":5.601343,"scheduling_latency_s":5.601365,"redis_calls":13,"redis_duration_s":0.002957,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018969,"completed_at":"2026-09-04T07:44:32.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 300.642566] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c84120f8553aa50f853ddbdb","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c84120f8553aa50f853ddbdb: start","job_status":"start","queue_duration_s":5.622154,"scheduling_latency_s":5.622175}1341gitlab # [ 300.655006] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c84120f8553aa50f853ddbdb","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c84120f8553aa50f853ddbdb: done: 0.020255 sec","job_status":"done","queue_duration_s":5.622154,"scheduling_latency_s":5.622175,"redis_calls":13,"redis_duration_s":0.003359,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001113,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002246,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020255,"completed_at":"2026-09-04T07:44:32.396Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 300.693464] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7fc1c96ae6995c36cfe03d3","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7fc1c96ae6995c36cfe03d3: start","job_status":"start","queue_duration_s":5.644323,"scheduling_latency_s":5.644346}1343gitlab # [ 300.705734] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7fc1c96ae6995c36cfe03d3","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7fc1c96ae6995c36cfe03d3: done: 0.020321 sec","job_status":"done","queue_duration_s":5.644323,"scheduling_latency_s":5.644346,"redis_calls":13,"redis_duration_s":0.0034270000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001165,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002262,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020321,"completed_at":"2026-09-04T07:44:32.418Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 300.745002] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"092bbf6c7ad5e5e6771819c2","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-092bbf6c7ad5e5e6771819c2: start","job_status":"start","queue_duration_s":5.666548,"scheduling_latency_s":5.66657}1345gitlab # [ 300.757429] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"092bbf6c7ad5e5e6771819c2","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-092bbf6c7ad5e5e6771819c2: done: 0.020596 sec","job_status":"done","queue_duration_s":5.666548,"scheduling_latency_s":5.66657,"redis_calls":13,"redis_duration_s":0.003446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020596,"completed_at":"2026-09-04T07:44:32.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 300.796635] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"570ad5c7ad06c4a6c396fb5d","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-570ad5c7ad06c4a6c396fb5d: start","job_status":"start","queue_duration_s":5.689352,"scheduling_latency_s":5.689379}1347gitlab # [ 300.808919] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"570ad5c7ad06c4a6c396fb5d","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-570ad5c7ad06c4a6c396fb5d: done: 0.02129 sec","job_status":"done","queue_duration_s":5.689352,"scheduling_latency_s":5.689379,"redis_calls":13,"redis_duration_s":0.0036349999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002518,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02129,"completed_at":"2026-09-04T07:44:32.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 300.848525] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e490782ce997b3d093ceba56","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e490782ce997b3d093ceba56: start","job_status":"start","queue_duration_s":5.712453,"scheduling_latency_s":5.712659}1349gitlab # [ 300.860703] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e490782ce997b3d093ceba56","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e490782ce997b3d093ceba56: done: 0.017801 sec","job_status":"done","queue_duration_s":5.712453,"scheduling_latency_s":5.712659,"redis_calls":13,"redis_duration_s":0.0034590000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017801,"completed_at":"2026-09-04T07:44:32.484Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 300.899342] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14f79048c4e63d68d3cb387b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14f79048c4e63d68d3cb387b: start","job_status":"start","queue_duration_s":5.731885,"scheduling_latency_s":5.731905}1351gitlab # [ 300.911770] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14f79048c4e63d68d3cb387b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14f79048c4e63d68d3cb387b: done: 0.016898 sec","job_status":"done","queue_duration_s":5.731885,"scheduling_latency_s":5.731905,"redis_calls":13,"redis_duration_s":0.002909,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016898,"completed_at":"2026-09-04T07:44:32.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 300.950507] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d473cbeaca7ac01b77aa3a3","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d473cbeaca7ac01b77aa3a3: start","job_status":"start","queue_duration_s":5.750511,"scheduling_latency_s":5.750532}1353gitlab # [ 300.962801] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d473cbeaca7ac01b77aa3a3","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d473cbeaca7ac01b77aa3a3: done: 0.017521 sec","job_status":"done","queue_duration_s":5.750511,"scheduling_latency_s":5.750532,"redis_calls":13,"redis_duration_s":0.003141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017521,"completed_at":"2026-09-04T07:44:32.521Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 301.001078] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72a218d4117945fa1afc9f3b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72a218d4117945fa1afc9f3b: start","job_status":"start","queue_duration_s":5.769868,"scheduling_latency_s":5.769891}1355gitlab # [ 301.013013] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72a218d4117945fa1afc9f3b","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72a218d4117945fa1afc9f3b: done: 0.017395 sec","job_status":"done","queue_duration_s":5.769868,"scheduling_latency_s":5.769891,"redis_calls":13,"redis_duration_s":0.0030089999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017395,"completed_at":"2026-09-04T07:44:32.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 301.052678] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f4dd79de32f7198c497895f","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f4dd79de32f7198c497895f: start","job_status":"start","queue_duration_s":5.789103,"scheduling_latency_s":5.789123}1357gitlab # [ 301.064893] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f4dd79de32f7198c497895f","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f4dd79de32f7198c497895f: done: 0.016928 sec","job_status":"done","queue_duration_s":5.789103,"scheduling_latency_s":5.789123,"redis_calls":13,"redis_duration_s":0.002828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016928,"completed_at":"2026-09-04T07:44:32.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 301.103486] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbb341617a5ab66abb6e5830","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbb341617a5ab66abb6e5830: start","job_status":"start","queue_duration_s":5.807705,"scheduling_latency_s":5.807726}1359gitlab # [ 301.115834] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbb341617a5ab66abb6e5830","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbb341617a5ab66abb6e5830: done: 0.017731 sec","job_status":"done","queue_duration_s":5.807705,"scheduling_latency_s":5.807726,"redis_calls":13,"redis_duration_s":0.0031320000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017731,"completed_at":"2026-09-04T07:44:32.579Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 301.154514] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f04415584063843296bd0028","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f04415584063843296bd0028: start","job_status":"start","queue_duration_s":5.827159,"scheduling_latency_s":5.827178}1361gitlab # [ 301.166813] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f04415584063843296bd0028","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f04415584063843296bd0028: done: 0.017506 sec","job_status":"done","queue_duration_s":5.827159,"scheduling_latency_s":5.827178,"redis_calls":13,"redis_duration_s":0.003055,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017506,"completed_at":"2026-09-04T07:44:32.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 301.205462] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb379b388873549531cc06a5","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb379b388873549531cc06a5: start","job_status":"start","queue_duration_s":5.846739,"scheduling_latency_s":5.846759}1363gitlab # [ 301.217706] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb379b388873549531cc06a5","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb379b388873549531cc06a5: done: 0.017862 sec","job_status":"done","queue_duration_s":5.846739,"scheduling_latency_s":5.846759,"redis_calls":13,"redis_duration_s":0.003222,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017862,"completed_at":"2026-09-04T07:44:32.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 301.257456] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"460aa5887916122e83e34fee","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-460aa5887916122e83e34fee: start","job_status":"start","queue_duration_s":5.866418,"scheduling_latency_s":5.86644}1365gitlab # [ 301.269726] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"460aa5887916122e83e34fee","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-460aa5887916122e83e34fee: done: 0.018128 sec","job_status":"done","queue_duration_s":5.866418,"scheduling_latency_s":5.86644,"redis_calls":13,"redis_duration_s":0.0032589999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018128,"completed_at":"2026-09-04T07:44:32.638Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 301.308242] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f22d95ccbf8699b119a99f74","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f22d95ccbf8699b119a99f74: start","job_status":"start","queue_duration_s":5.886385,"scheduling_latency_s":5.886409}1367gitlab # [ 301.320413] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f22d95ccbf8699b119a99f74","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f22d95ccbf8699b119a99f74: done: 0.018074 sec","job_status":"done","queue_duration_s":5.886385,"scheduling_latency_s":5.886409,"redis_calls":13,"redis_duration_s":0.003238,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018074,"completed_at":"2026-09-04T07:44:32.658Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 301.359013] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc61455da56b2d9f60faaed1","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc61455da56b2d9f60faaed1: start","job_status":"start","queue_duration_s":5.906239,"scheduling_latency_s":5.906259}1369gitlab # [ 301.371329] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc61455da56b2d9f60faaed1","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc61455da56b2d9f60faaed1: done: 0.01645 sec","job_status":"done","queue_duration_s":5.906239,"scheduling_latency_s":5.906259,"redis_calls":13,"redis_duration_s":0.002765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001794,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01645,"completed_at":"2026-09-04T07:44:32.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 301.410067] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a567e72bd7fd06046fe1a1ff","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a567e72bd7fd06046fe1a1ff: start","job_status":"start","queue_duration_s":5.924321,"scheduling_latency_s":5.92434}1371gitlab # [ 301.422351] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a567e72bd7fd06046fe1a1ff","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a567e72bd7fd06046fe1a1ff: done: 0.017583 sec","job_status":"done","queue_duration_s":5.924321,"scheduling_latency_s":5.92434,"redis_calls":13,"redis_duration_s":0.003547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002435,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017583,"completed_at":"2026-09-04T07:44:32.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 301.461880] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"020491e9df97b0582359b44f","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-020491e9df97b0582359b44f: start","job_status":"start","queue_duration_s":5.943536,"scheduling_latency_s":5.943557}1373gitlab # [ 301.474083] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"020491e9df97b0582359b44f","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-020491e9df97b0582359b44f: done: 0.016919 sec","job_status":"done","queue_duration_s":5.943536,"scheduling_latency_s":5.943557,"redis_calls":13,"redis_duration_s":0.0029430000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016919,"completed_at":"2026-09-04T07:44:32.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 301.512461] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f874dab08e6e7f8db0d6a91","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f874dab08e6e7f8db0d6a91: start","job_status":"start","queue_duration_s":5.962169,"scheduling_latency_s":5.962187}1375gitlab # [ 301.524928] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f874dab08e6e7f8db0d6a91","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f874dab08e6e7f8db0d6a91: done: 0.01676 sec","job_status":"done","queue_duration_s":5.962169,"scheduling_latency_s":5.962187,"redis_calls":13,"redis_duration_s":0.0028710000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01676,"completed_at":"2026-09-04T07:44:32.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 301.563922] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e92a9904820e14cfcd40a56","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e92a9904820e14cfcd40a56: start","job_status":"start","queue_duration_s":5.980541,"scheduling_latency_s":5.980559}1377gitlab # [ 301.576456] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e92a9904820e14cfcd40a56","created_at":"2026-09-04T07:44:26.038Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a0eef25a385f4f59","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"80791ff6d07f44fc24ab4a9016500614","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:26.753Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e92a9904820e14cfcd40a56: done: 0.016828 sec","job_status":"done","queue_duration_s":5.980541,"scheduling_latency_s":5.980559,"redis_calls":13,"redis_duration_s":0.003118,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016828,"completed_at":"2026-09-04T07:44:32.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 301.615230] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"0ece4e892c8c7e8044d15a87","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-0ece4e892c8c7e8044d15a87: start","job_status":"start","queue_duration_s":5.429494,"scheduling_latency_s":5.429513}1379gitlab # [ 301.628461] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"0ece4e892c8c7e8044d15a87","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-0ece4e892c8c7e8044d15a87: done: 0.063851 sec","job_status":"done","queue_duration_s":5.429494,"scheduling_latency_s":5.429513,"redis_calls":16,"redis_duration_s":0.004804,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001389,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002818,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040836,"duration_s":0.063851,"completed_at":"2026-09-04T07:44:32.816Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022952,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 301.670297] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"522a68f59dcbf830824bcae6","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-522a68f59dcbf830824bcae6: start","job_status":"start","queue_duration_s":5.495476,"scheduling_latency_s":5.495503}1381gitlab # [ 301.683435] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"522a68f59dcbf830824bcae6","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-522a68f59dcbf830824bcae6: done: 0.022011 sec","job_status":"done","queue_duration_s":5.495476,"scheduling_latency_s":5.495503,"redis_calls":13,"redis_duration_s":0.0035529999999999997,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002443,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022011,"completed_at":"2026-09-04T07:44:32.840Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 301.722450] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"53398967a39a7166c88f2e62","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-53398967a39a7166c88f2e62: start","job_status":"start","queue_duration_s":5.519622,"scheduling_latency_s":5.519649}1383gitlab # [ 301.735637] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"53398967a39a7166c88f2e62","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-53398967a39a7166c88f2e62: done: 0.020569 sec","job_status":"done","queue_duration_s":5.519622,"scheduling_latency_s":5.519649,"redis_calls":13,"redis_duration_s":0.003162,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020569,"completed_at":"2026-09-04T07:44:32.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 301.774868] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5ccbe4756051fadd3c26451d","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5ccbe4756051fadd3c26451d: start","job_status":"start","queue_duration_s":5.542007,"scheduling_latency_s":5.54203}1385gitlab # [ 301.788115] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5ccbe4756051fadd3c26451d","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5ccbe4756051fadd3c26451d: done: 0.020144 sec","job_status":"done","queue_duration_s":5.542007,"scheduling_latency_s":5.54203,"redis_calls":13,"redis_duration_s":0.0033339999999999997,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001019,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002315,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020144,"completed_at":"2026-09-04T07:44:32.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002178,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 301.827549] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"759e0454335c166135669d2e","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-759e0454335c166135669d2e: start","job_status":"start","queue_duration_s":5.564418,"scheduling_latency_s":5.564441}1387gitlab # [ 301.840898] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"759e0454335c166135669d2e","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-759e0454335c166135669d2e: done: 0.022763 sec","job_status":"done","queue_duration_s":5.564418,"scheduling_latency_s":5.564441,"redis_calls":13,"redis_duration_s":0.003525,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002397,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022763,"completed_at":"2026-09-04T07:44:32.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 301.880565] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e7cfd11c6e924f5901e104f3","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e7cfd11c6e924f5901e104f3: start","job_status":"start","queue_duration_s":5.588946,"scheduling_latency_s":5.58897}1389gitlab # [ 301.893599] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e7cfd11c6e924f5901e104f3","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e7cfd11c6e924f5901e104f3: done: 0.021188 sec","job_status":"done","queue_duration_s":5.588946,"scheduling_latency_s":5.58897,"redis_calls":13,"redis_duration_s":0.0021130000000000003,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001347,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021188,"completed_at":"2026-09-04T07:44:32.933Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 301.932838] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"dc2fbfb51554d1cccee4f5e5","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-dc2fbfb51554d1cccee4f5e5: start","job_status":"start","queue_duration_s":5.612293,"scheduling_latency_s":5.612316}1391gitlab # [ 301.945902] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"dc2fbfb51554d1cccee4f5e5","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-dc2fbfb51554d1cccee4f5e5: done: 0.022807 sec","job_status":"done","queue_duration_s":5.612293,"scheduling_latency_s":5.612316,"redis_calls":13,"redis_duration_s":0.0037339999999999995,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002436,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022807,"completed_at":"2026-09-04T07:44:32.958Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 301.985071] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7e20222519ec759a7d9c8be7","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7e20222519ec759a7d9c8be7: start","job_status":"start","queue_duration_s":5.637491,"scheduling_latency_s":5.637515}1393gitlab # [ 301.998203] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7e20222519ec759a7d9c8be7","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7e20222519ec759a7d9c8be7: done: 0.022437 sec","job_status":"done","queue_duration_s":5.637491,"scheduling_latency_s":5.637515,"redis_calls":13,"redis_duration_s":0.003561,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001113,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002448,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022437,"completed_at":"2026-09-04T07:44:32.983Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001469,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 302.037265] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:32.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"22306ad184b8711c809ad76d","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-22306ad184b8711c809ad76d: start","job_status":"start","queue_duration_s":5.6616,"scheduling_latency_s":5.661621}1395gitlab # [ 302.050475] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"22306ad184b8711c809ad76d","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-22306ad184b8711c809ad76d: done: 0.022741 sec","job_status":"done","queue_duration_s":5.6616,"scheduling_latency_s":5.661621,"redis_calls":13,"redis_duration_s":0.002978,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022741,"completed_at":"2026-09-04T07:44:33.007Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 302.091031] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6a9a368ff5f6e565805eedac","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6a9a368ff5f6e565805eedac: start","job_status":"start","queue_duration_s":5.689222,"scheduling_latency_s":5.68928}1397gitlab # [ 302.104370] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"6a9a368ff5f6e565805eedac","created_at":"2026-09-04T07:44:27.042Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-206e33f3b13c42e9","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"8c97742e3a1d44bdc09c3d18bbde9828","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:27.323Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-6a9a368ff5f6e565805eedac: done: 0.044573 sec","job_status":"done","queue_duration_s":5.689222,"scheduling_latency_s":5.68928,"redis_calls":13,"redis_duration_s":0.005053,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003464,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044573,"completed_at":"2026-09-04T07:44:33.056Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 302.143577] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.061Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6d067b5d09355148ce6c9d96","created_at":"2026-09-04T07:44:28.090Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-9dab22068c354d46","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:28.148Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6d067b5d09355148ce6c9d96: start","job_status":"start","queue_duration_s":4.912796,"scheduling_latency_s":4.912836}1399gitlab # [ 302.155993] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.092Z","message":"No existing merge request to be cleaned up."}1400gitlab # [ 302.157643] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.113Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6d067b5d09355148ce6c9d96","created_at":"2026-09-04T07:44:28.090Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-9dab22068c354d46","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:28.148Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6d067b5d09355148ce6c9d96: done: 0.052204 sec","job_status":"done","queue_duration_s":4.912796,"scheduling_latency_s":4.912836,"redis_calls":13,"redis_duration_s":0.004798,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000847,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002243,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003823,"duration_s":0.052204,"completed_at":"2026-09-04T07:44:33.113Z","load_balancing_strategy":"primary","db_duration_s":0.008193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 302.197600] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.115Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c0bff71e43299704b2784cd9","created_at":"2026-09-04T07:44:28.090Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-9dab22068c354d46","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:28.148Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c0bff71e43299704b2784cd9: start","job_status":"start","queue_duration_s":4.967128,"scheduling_latency_s":4.96715}1402gitlab # [ 302.209829] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.129Z","message":"No existing merge request to be cleaned up."}1403gitlab # [ 302.211459] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.141Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c0bff71e43299704b2784cd9","created_at":"2026-09-04T07:44:28.090Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-9dab22068c354d46","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:28.148Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c0bff71e43299704b2784cd9: done: 0.025933 sec","job_status":"done","queue_duration_s":4.967128,"scheduling_latency_s":4.96715,"redis_calls":10,"redis_duration_s":0.002861,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001676,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025933,"completed_at":"2026-09-04T07:44:33.141Z","load_balancing_strategy":"primary","db_duration_s":0.003054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 302.250106] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.143Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"08d2a92c732c82adbc569232","created_at":"2026-09-04T07:44:28.090Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-9dab22068c354d46","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:28.148Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-08d2a92c732c82adbc569232: start","job_status":"start","queue_duration_s":4.995019,"scheduling_latency_s":4.995042}1405gitlab # [ 302.263493] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.157Z","message":"No existing merge request to be cleaned up."}1406gitlab # [ 302.265516] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.169Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"08d2a92c732c82adbc569232","created_at":"2026-09-04T07:44:28.090Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-9dab22068c354d46","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:28.148Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-08d2a92c732c82adbc569232: done: 0.025952 sec","job_status":"done","queue_duration_s":4.995019,"scheduling_latency_s":4.995042,"redis_calls":10,"redis_duration_s":0.0029049999999999996,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001687,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025952,"completed_at":"2026-09-04T07:44:33.169Z","load_balancing_strategy":"primary","db_duration_s":0.003127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 302.303879] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.171Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce56bd6a7de84b2ab2dcdd2c","created_at":"2026-09-04T07:44:28.090Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-9dab22068c354d46","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:28.148Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce56bd6a7de84b2ab2dcdd2c: start","job_status":"start","queue_duration_s":5.022829,"scheduling_latency_s":5.022853}1408gitlab # [ 302.316294] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.185Z","message":"No existing merge request to be cleaned up."}1409gitlab # [ 302.317954] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:44:33.198Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce56bd6a7de84b2ab2dcdd2c","created_at":"2026-09-04T07:44:28.090Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-9dab22068c354d46","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e4af32d4321ebc17d28919b1f5991aac","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:28.148Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce56bd6a7de84b2ab2dcdd2c: done: 0.026825 sec","job_status":"done","queue_duration_s":5.022829,"scheduling_latency_s":5.022853,"redis_calls":10,"redis_duration_s":0.002984,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00128,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001704,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026825,"completed_at":"2026-09-04T07:44:33.198Z","load_balancing_strategy":"primary","db_duration_s":0.003622,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 314.514241] redis[805]: 10 changes in 300 seconds. Saving...1411gitlab # [ 314.518741] redis[805]: Background saving started by pid 34851412gitlab # [ 314.526244] redis[3485]: BGSAVE done, 436 keys saved, 0 keys skipped, 115347 bytes written.1413gitlab # [ 314.532417] redis[3485]: DB saved on disk1414gitlab # [ 314.534666] redis[3485]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1415gitlab # [ 314.615408] redis[805]: Background saving terminated with success1416gitlab # [ 316.609230] postgres[904]: [904] LOG: checkpoint starting: time1417gitlab # [ 320.542289] gitaly[1041]: time="2026-09-04T07:44:55.126Z" level=info msg="burden monitor stats" pid=10411418gitlab # [ 327.411967] setup-gitlab-start[3335]: W, [2026-09-04T07:45:01.996524 #3335] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1419gitlab # [ 332.513009] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:07.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b6f80f0e854bb6476258450a","created_at":"2026-09-04T07:45:07.083Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03d7c51407cad7a67c7f9a128124ed1b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:45:07.091Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b6f80f0e854bb6476258450a: start","job_status":"start","queue_duration_s":0.00447,"scheduling_latency_s":0.004517}1420gitlab # [ 332.666496] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:07.251Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1421gitlab # [ 332.747060] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:07.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b6f80f0e854bb6476258450a","created_at":"2026-09-04T07:45:07.083Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03d7c51407cad7a67c7f9a128124ed1b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:45:07.091Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b6f80f0e854bb6476258450a: done: 0.234218 sec","job_status":"done","queue_duration_s":0.00447,"scheduling_latency_s":0.004517,"redis_calls":9,"redis_duration_s":0.037007,"redis_read_bytes":137,"redis_write_bytes":869,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.024154,"redis_feature_flag_read_bytes":132,"redis_feature_flag_write_bytes":68,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003369,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.234218,"completed_at":"2026-09-04T07:45:07.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 332.836680] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:07.344Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bec57298f9fb9c15d87c046b","created_at":"2026-09-04T07:45:07.139Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1747532058d66dd3d329537db5ef66e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.181Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bec57298f9fb9c15d87c046b: start","job_status":"start","queue_duration_s":0.163229,"scheduling_latency_s":0.163455}1423gitlab # [ 333.125236] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:07.707Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bec57298f9fb9c15d87c046b","created_at":"2026-09-04T07:45:07.139Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1747532058d66dd3d329537db5ef66e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.181Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bec57298f9fb9c15d87c046b: done: 0.363845 sec","job_status":"done","queue_duration_s":0.163229,"scheduling_latency_s":0.163455,"redis_calls":19,"redis_duration_s":0.042406,"redis_read_bytes":1160,"redis_write_bytes":1827,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.015958,"redis_feature_flag_read_bytes":1152,"redis_feature_flag_write_bytes":588,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013041,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.013407,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.095,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.095,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10798058,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.363845,"completed_at":"2026-09-04T07:45:07.707Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.094266,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1424gitlab # [ 333.217416] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:07.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5286b4f983c6ef3c1da9d9d4","created_at":"2026-09-04T07:45:07.243Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8e70bb21880bbacce7c07975fd13ca8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.276Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5286b4f983c6ef3c1da9d9d4: start","job_status":"start","queue_duration_s":0.526117,"scheduling_latency_s":0.52617}1425gitlab # [ 333.383648] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:07.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5286b4f983c6ef3c1da9d9d4","created_at":"2026-09-04T07:45:07.243Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8e70bb21880bbacce7c07975fd13ca8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.276Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5286b4f983c6ef3c1da9d9d4: done: 0.163393 sec","job_status":"done","queue_duration_s":0.526117,"scheduling_latency_s":0.52617,"redis_calls":7,"redis_duration_s":0.026422,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009141,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.163393,"completed_at":"2026-09-04T07:45:07.965Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 333.482387] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:07.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"a3abd219acb9379564db190d","created_at":"2026-09-04T07:45:07.322Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9358831f8af21741528f4d053b2889c5","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.432Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-a3abd219acb9379564db190d: start","job_status":"start","queue_duration_s":0.56186,"scheduling_latency_s":0.561934}1427gitlab # [ 333.834782] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:08.416Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"a3abd219acb9379564db190d","created_at":"2026-09-04T07:45:07.322Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9358831f8af21741528f4d053b2889c5","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.432Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-a3abd219acb9379564db190d: done: 0.421688 sec","job_status":"done","queue_duration_s":0.56186,"scheduling_latency_s":0.561934,"redis_calls":11,"redis_duration_s":0.05221,"redis_read_bytes":13,"redis_write_bytes":1101,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.013802,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":313,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.027503,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.010905,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.11771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0030561,"duration_s":0.421688,"completed_at":"2026-09-04T07:45:08.415Z","load_balancing_strategy":"primary","db_duration_s":0.053854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 333.929822] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:08.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"da5f68d6f8bc6ad9675dc8d1","created_at":"2026-09-04T07:45:07.445Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34e2a94fac6236cb8be451e72f6de9b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.450Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-da5f68d6f8bc6ad9675dc8d1: start","job_status":"start","queue_duration_s":0.997914,"scheduling_latency_s":0.997984}1429gitlab # [ 334.455854] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"da5f68d6f8bc6ad9675dc8d1","created_at":"2026-09-04T07:45:07.445Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34e2a94fac6236cb8be451e72f6de9b9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.450Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-da5f68d6f8bc6ad9675dc8d1: done: 0.590274 sec","job_status":"done","queue_duration_s":0.997914,"scheduling_latency_s":0.997984,"redis_calls":9,"redis_duration_s":0.10639299999999999,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.068476,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.037917,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.126,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.126,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00643382,"exclusive_lock_hold_duration_s":0.19105528,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.590274,"completed_at":"2026-09-04T07:45:09.038Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.205381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 334.553859] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d7171a4c399b1ef796f2eb66","created_at":"2026-09-04T07:45:07.465Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7fd6e4fa314b416ff48d7c39160bb0d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.472Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d7171a4c399b1ef796f2eb66: start","job_status":"start","queue_duration_s":1.639622,"scheduling_latency_s":1.63977}1431gitlab # [ 334.643931] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.228Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d7171a4c399b1ef796f2eb66","created_at":"2026-09-04T07:45:07.465Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7fd6e4fa314b416ff48d7c39160bb0d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.472Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d7171a4c399b1ef796f2eb66: done: 0.115855 sec","job_status":"done","queue_duration_s":1.639622,"scheduling_latency_s":1.63977,"redis_calls":9,"redis_duration_s":0.013167,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008345,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00282756,"exclusive_lock_hold_duration_s":0.01727328,"duration_s":0.115855,"completed_at":"2026-09-04T07:45:09.227Z","load_balancing_strategy":"primary","db_duration_s":0.003754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 334.730669] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6e742e5cc2af28f9f27e832b","created_at":"2026-09-04T07:45:07.524Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b799114b6e4181c7aada3d75d12b0cbe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.534Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6e742e5cc2af28f9f27e832b: start","job_status":"start","queue_duration_s":1.699051,"scheduling_latency_s":1.699126}1433gitlab # [ 334.749091] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6e742e5cc2af28f9f27e832b","created_at":"2026-09-04T07:45:07.524Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b799114b6e4181c7aada3d75d12b0cbe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.534Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6e742e5cc2af28f9f27e832b: done: 0.043774 sec","job_status":"done","queue_duration_s":1.699051,"scheduling_latency_s":1.699126,"redis_calls":8,"redis_duration_s":0.003679,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000509,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043774,"completed_at":"2026-09-04T07:45:09.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 334.804040] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"dc72d889055d9e29e9a81970","created_at":"2026-09-04T07:45:07.570Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.593Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-dc72d889055d9e29e9a81970: start","job_status":"start","queue_duration_s":1.686708,"scheduling_latency_s":1.686771}1435gitlab # [ 335.052463] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"dc72d889055d9e29e9a81970","created_at":"2026-09-04T07:45:07.570Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.593Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-dc72d889055d9e29e9a81970: done: 0.354321 sec","job_status":"done","queue_duration_s":1.686708,"scheduling_latency_s":1.686771,"redis_calls":60,"redis_duration_s":0.035877,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.002316,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.030846,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002715,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.326037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.354321,"completed_at":"2026-09-04T07:45:09.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 335.146776] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"07722b14ba41e73e13acee68","created_at":"2026-09-04T07:45:07.681Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e75854ea147a37fe78dd33c25b3795f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.697Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-07722b14ba41e73e13acee68: start","job_status":"start","queue_duration_s":1.943028,"scheduling_latency_s":1.943076}1437gitlab # [ 335.165436] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"07722b14ba41e73e13acee68","created_at":"2026-09-04T07:45:07.681Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e75854ea147a37fe78dd33c25b3795f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.697Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-07722b14ba41e73e13acee68: done: 0.05943 sec","job_status":"done","queue_duration_s":1.943028,"scheduling_latency_s":1.943076,"redis_calls":9,"redis_duration_s":0.0049759999999999995,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002394,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002582,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00201236,"exclusive_lock_hold_duration_s":0.01006206,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.05943,"completed_at":"2026-09-04T07:45:09.699Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 335.215478] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"eec392dd776d7b4d6789a859","created_at":"2026-09-04T07:45:07.793Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe4da0be99009fd224a29d7aeebdd402","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.818Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-eec392dd776d7b4d6789a859: start","job_status":"start","queue_duration_s":1.885841,"scheduling_latency_s":1.885886}1439gitlab # [ 335.232431] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"eec392dd776d7b4d6789a859","created_at":"2026-09-04T07:45:07.793Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe4da0be99009fd224a29d7aeebdd402","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.818Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-eec392dd776d7b4d6789a859: done: 0.042065 sec","job_status":"done","queue_duration_s":1.885841,"scheduling_latency_s":1.885886,"redis_calls":11,"redis_duration_s":0.004642,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000985,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002459,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065026,"duration_s":0.042065,"completed_at":"2026-09-04T07:45:09.745Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001082,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 335.277933] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"577fb658e5b0b2a140f09968","created_at":"2026-09-04T07:45:07.844Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7706f4a7ce0fde7227bf82e5e329eacc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:45:07.853Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-577fb658e5b0b2a140f09968: start","job_status":"start","queue_duration_s":1.895895,"scheduling_latency_s":1.895924}1441gitlab # [ 335.291632] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"577fb658e5b0b2a140f09968","created_at":"2026-09-04T07:45:07.844Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7706f4a7ce0fde7227bf82e5e329eacc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:45:07.853Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-577fb658e5b0b2a140f09968: done: 0.043232 sec","job_status":"done","queue_duration_s":1.895895,"scheduling_latency_s":1.895924,"redis_calls":7,"redis_duration_s":0.003286,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043232,"completed_at":"2026-09-04T07:45:09.792Z","load_balancing_strategy":"primary","db_duration_s":0.006127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 335.334117] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.795Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"6810729c45a15f7c9f7db933","created_at":"2026-09-04T07:45:07.896Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4aefa84d4e9570211b3dc61f96e6624a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.932Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-6810729c45a15f7c9f7db933: start","job_status":"start","queue_duration_s":1.862992,"scheduling_latency_s":1.863025}1443gitlab # [ 335.348966] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"6810729c45a15f7c9f7db933","created_at":"2026-09-04T07:45:07.896Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4aefa84d4e9570211b3dc61f96e6624a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.932Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-6810729c45a15f7c9f7db933: done: 0.073372 sec","job_status":"done","queue_duration_s":1.862992,"scheduling_latency_s":1.863025,"redis_calls":11,"redis_duration_s":0.006817,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001165,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001519,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001425,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0011055,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.073372,"completed_at":"2026-09-04T07:45:09.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 335.396329] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2a60ae98dc1dfbe581d9efcd","created_at":"2026-09-04T07:45:07.958Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a9d4f255291d8dd0e630f1663293f9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.981Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2a60ae98dc1dfbe581d9efcd: start","job_status":"start","queue_duration_s":1.890452,"scheduling_latency_s":1.890506}1445gitlab # [ 335.411841] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.892Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1446gitlab # [ 335.415543] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2a60ae98dc1dfbe581d9efcd","created_at":"2026-09-04T07:45:07.958Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a9d4f255291d8dd0e630f1663293f9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:07.981Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2a60ae98dc1dfbe581d9efcd: done: 0.03209 sec","job_status":"done","queue_duration_s":1.890452,"scheduling_latency_s":1.890506,"redis_calls":7,"redis_duration_s":0.002888,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00206,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000828,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03209,"completed_at":"2026-09-04T07:45:09.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 335.458415] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"23fce3bc2c3a4fb949d3aff1","created_at":"2026-09-04T07:45:08.021Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.034Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-23fce3bc2c3a4fb949d3aff1: start","job_status":"start","queue_duration_s":1.872916,"scheduling_latency_s":1.872961}1448gitlab # [ 335.472569] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"23fce3bc2c3a4fb949d3aff1","created_at":"2026-09-04T07:45:08.021Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.034Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-23fce3bc2c3a4fb949d3aff1: done: 0.084833 sec","job_status":"done","queue_duration_s":1.872916,"scheduling_latency_s":1.872961,"redis_calls":14,"redis_duration_s":0.0036520000000000003,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000283,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002507,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.084833,"completed_at":"2026-09-04T07:45:09.991Z","load_balancing_strategy":"primary","db_duration_s":0.001781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 335.515180] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:09.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0ff4fc3afdeaa1b126eff7ee","created_at":"2026-09-04T07:45:08.058Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf77a2c2ebad60462ba6ee61fc8babf8","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.067Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0ff4fc3afdeaa1b126eff7ee: start","job_status":"start","queue_duration_s":1.926064,"scheduling_latency_s":1.926094}1450gitlab # [ 335.761100] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0ff4fc3afdeaa1b126eff7ee","created_at":"2026-09-04T07:45:08.058Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf77a2c2ebad60462ba6ee61fc8babf8","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.067Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0ff4fc3afdeaa1b126eff7ee: done: 0.352513 sec","job_status":"done","queue_duration_s":1.926064,"scheduling_latency_s":1.926094,"redis_calls":562,"redis_duration_s":0.07894200000000001,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.077992,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.316448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.352513,"completed_at":"2026-09-04T07:45:10.346Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 335.859376] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1710e1083bbc42f09232fbb2","created_at":"2026-09-04T07:45:08.088Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"637c78e858c8fd345a22c313d0a8212f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.098Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1710e1083bbc42f09232fbb2: start","job_status":"start","queue_duration_s":2.249706,"scheduling_latency_s":2.249737}1452gitlab # [ 335.879347] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.358Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1453gitlab # [ 335.883425] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1710e1083bbc42f09232fbb2","created_at":"2026-09-04T07:45:08.088Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"637c78e858c8fd345a22c313d0a8212f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.098Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1710e1083bbc42f09232fbb2: done: 0.017014 sec","job_status":"done","queue_duration_s":2.249706,"scheduling_latency_s":2.249737,"redis_calls":7,"redis_duration_s":0.001719,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001222,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017014,"completed_at":"2026-09-04T07:45:10.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 335.927159] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.367Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"a55341666982424bd6d24618","created_at":"2026-09-04T07:45:08.149Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4805be3629ca9de507ad747829ff34db","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.209Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-a55341666982424bd6d24618: start","job_status":"start","queue_duration_s":2.158286,"scheduling_latency_s":2.158315}1455gitlab # [ 335.940929] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"a55341666982424bd6d24618","created_at":"2026-09-04T07:45:08.149Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4805be3629ca9de507ad747829ff34db","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.209Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-a55341666982424bd6d24618: done: 0.036018 sec","job_status":"done","queue_duration_s":2.158286,"scheduling_latency_s":2.158315,"redis_calls":11,"redis_duration_s":0.003262,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038118,"duration_s":0.036018,"completed_at":"2026-09-04T07:45:10.403Z","load_balancing_strategy":"primary","db_duration_s":0.006292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 335.983250] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"84f66b7fbad93c52cccdebf7","created_at":"2026-09-04T07:45:08.295Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"754a78510290db66b806e47cdfb11bde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:45:08.310Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-84f66b7fbad93c52cccdebf7: start","job_status":"start","queue_duration_s":2.095161,"scheduling_latency_s":2.095188}1457gitlab # [ 335.998440] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.415Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1458gitlab # [ 336.001832] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.422Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"84f66b7fbad93c52cccdebf7","created_at":"2026-09-04T07:45:08.295Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"754a78510290db66b806e47cdfb11bde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:45:08.310Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-84f66b7fbad93c52cccdebf7: done: 0.017219 sec","job_status":"done","queue_duration_s":2.095161,"scheduling_latency_s":2.095188,"redis_calls":7,"redis_duration_s":0.002996,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002438,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017219,"completed_at":"2026-09-04T07:45:10.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 336.041815] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9f29ca29924b9ecc2177873d","created_at":"2026-09-04T07:45:08.387Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aca97d7beb8e820d2d4ee1becfa71118","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.404Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9f29ca29924b9ecc2177873d: start","job_status":"start","queue_duration_s":2.019926,"scheduling_latency_s":2.019954}1460gitlab # [ 336.056908] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9f29ca29924b9ecc2177873d","created_at":"2026-09-04T07:45:08.387Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aca97d7beb8e820d2d4ee1becfa71118","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.404Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9f29ca29924b9ecc2177873d: done: 0.017229 sec","job_status":"done","queue_duration_s":2.019926,"scheduling_latency_s":2.019954,"redis_calls":7,"redis_duration_s":0.0019909999999999997,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001408,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017229,"completed_at":"2026-09-04T07:45:10.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 336.097751] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.443Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c2c5f329e72a1911f66d476d","created_at":"2026-09-04T07:45:08.447Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81fb8bbdb7f4415852285b8770e5d394","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.467Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c2c5f329e72a1911f66d476d: start","job_status":"start","queue_duration_s":1.975962,"scheduling_latency_s":1.975988}1462gitlab # [ 336.254872] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.839Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c2c5f329e72a1911f66d476d","created_at":"2026-09-04T07:45:08.447Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81fb8bbdb7f4415852285b8770e5d394","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.467Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c2c5f329e72a1911f66d476d: done: 0.395975 sec","job_status":"done","queue_duration_s":1.975962,"scheduling_latency_s":1.975988,"redis_calls":9,"redis_duration_s":0.002674,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001234,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00144,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.058,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.326547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00067906,"exclusive_lock_hold_duration_s":0.37473798,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.395975,"completed_at":"2026-09-04T07:45:10.839Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.088793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 336.348830] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.841Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f1b98484cb1021a87ac16e72","created_at":"2026-09-04T07:45:08.511Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e429c0601b51464689cb0a94100d1f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.523Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f1b98484cb1021a87ac16e72: start","job_status":"start","queue_duration_s":2.317977,"scheduling_latency_s":2.318005}1464gitlab # [ 336.366896] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f1b98484cb1021a87ac16e72","created_at":"2026-09-04T07:45:08.511Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e429c0601b51464689cb0a94100d1f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.523Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f1b98484cb1021a87ac16e72: done: 0.052635 sec","job_status":"done","queue_duration_s":2.317977,"scheduling_latency_s":2.318005,"redis_calls":9,"redis_duration_s":0.003274,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00074008,"exclusive_lock_hold_duration_s":0.02963304,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.052635,"completed_at":"2026-09-04T07:45:10.894Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 336.417111] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"53a76e31b8661a707bedc5af","created_at":"2026-09-04T07:45:08.627Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58afbe62f5fea313e1f40b384a601ab5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.659Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-53a76e31b8661a707bedc5af: start","job_status":"start","queue_duration_s":2.236938,"scheduling_latency_s":2.236969}1466gitlab # [ 336.434381] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.909Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1467gitlab # [ 336.438774] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.918Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"53a76e31b8661a707bedc5af","created_at":"2026-09-04T07:45:08.627Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58afbe62f5fea313e1f40b384a601ab5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.659Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-53a76e31b8661a707bedc5af: done: 0.021214 sec","job_status":"done","queue_duration_s":2.236938,"scheduling_latency_s":2.236969,"redis_calls":7,"redis_duration_s":0.00209,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001519,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021214,"completed_at":"2026-09-04T07:45:10.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 336.484163] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.920Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"44118a244d22713163e66536","created_at":"2026-09-04T07:45:08.715Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8eb8e8b0f3c2f6557289d7e672adccc3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.735Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-44118a244d22713163e66536: start","job_status":"start","queue_duration_s":2.184379,"scheduling_latency_s":2.184407}1469gitlab # [ 336.498731] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.947Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"44118a244d22713163e66536","created_at":"2026-09-04T07:45:08.715Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8eb8e8b0f3c2f6557289d7e672adccc3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.735Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-44118a244d22713163e66536: done: 0.027909 sec","job_status":"done","queue_duration_s":2.184379,"scheduling_latency_s":2.184407,"redis_calls":7,"redis_duration_s":0.002253,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027909,"completed_at":"2026-09-04T07:45:10.947Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006978,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 336.540382] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.949Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"4e608d9bf7a94b18cbcc954e","created_at":"2026-09-04T07:45:08.811Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4a66175526006f21c6ff52922c3e4af","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.844Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-4e608d9bf7a94b18cbcc954e: start","job_status":"start","queue_duration_s":2.105675,"scheduling_latency_s":2.105699}1471gitlab # [ 336.554137] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.985Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"4e608d9bf7a94b18cbcc954e","created_at":"2026-09-04T07:45:08.811Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4a66175526006f21c6ff52922c3e4af","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.844Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-4e608d9bf7a94b18cbcc954e: done: 0.035334 sec","job_status":"done","queue_duration_s":2.105675,"scheduling_latency_s":2.105699,"redis_calls":10,"redis_duration_s":0.002749,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000606,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000535,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038072,"duration_s":0.035334,"completed_at":"2026-09-04T07:45:10.985Z","load_balancing_strategy":"primary","db_duration_s":0.007294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 336.598123] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:10.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d698270b9889ad4ea9f2067c","created_at":"2026-09-04T07:45:08.914Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4365f7f1910817d9173a682acf14154","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.932Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d698270b9889ad4ea9f2067c: start","job_status":"start","queue_duration_s":2.056374,"scheduling_latency_s":2.056398}1473gitlab # [ 336.612594] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d698270b9889ad4ea9f2067c","created_at":"2026-09-04T07:45:08.914Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4365f7f1910817d9173a682acf14154","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:08.932Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d698270b9889ad4ea9f2067c: done: 0.029267 sec","job_status":"done","queue_duration_s":2.056374,"scheduling_latency_s":2.056398,"redis_calls":7,"redis_duration_s":0.0027340000000000003,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000809,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.029267,"completed_at":"2026-09-04T07:45:11.018Z","load_balancing_strategy":"primary","db_duration_s":0.007199,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 336.655254] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4c546d2b1499c120844736e6","created_at":"2026-09-04T07:45:08.988Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53108ac8a8bf417c8ff047776aabc171","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.004Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4c546d2b1499c120844736e6: start","job_status":"start","queue_duration_s":2.015951,"scheduling_latency_s":2.01597}1475gitlab # [ 336.670527] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.034Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1476gitlab # [ 336.674479] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4c546d2b1499c120844736e6","created_at":"2026-09-04T07:45:08.988Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-20aa7d5d7efa4b13","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53108ac8a8bf417c8ff047776aabc171","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.004Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4c546d2b1499c120844736e6: done: 0.021335 sec","job_status":"done","queue_duration_s":2.015951,"scheduling_latency_s":2.01597,"redis_calls":7,"redis_duration_s":0.007698999999999999,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021335,"completed_at":"2026-09-04T07:45:11.041Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 336.716908] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"539a9130592f638a1c507294","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-539a9130592f638a1c507294: start","job_status":"start","queue_duration_s":1.447459,"scheduling_latency_s":1.447479}1478gitlab # [ 336.729670] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"539a9130592f638a1c507294","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-539a9130592f638a1c507294: done: 0.017809 sec","job_status":"done","queue_duration_s":1.447459,"scheduling_latency_s":1.447479,"redis_calls":13,"redis_duration_s":0.002992,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017809,"completed_at":"2026-09-04T07:45:11.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 336.769085] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bfeec372b335614c5673b7e","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bfeec372b335614c5673b7e: start","job_status":"start","queue_duration_s":1.466856,"scheduling_latency_s":1.46689}1480gitlab # [ 336.781355] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bfeec372b335614c5673b7e","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bfeec372b335614c5673b7e: done: 0.018053 sec","job_status":"done","queue_duration_s":1.466856,"scheduling_latency_s":1.46689,"redis_calls":13,"redis_duration_s":0.0029779999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018053,"completed_at":"2026-09-04T07:45:11.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 336.821730] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45aaf8961a9601ece1729608","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45aaf8961a9601ece1729608: start","job_status":"start","queue_duration_s":1.486494,"scheduling_latency_s":1.486512}1482gitlab # [ 336.834160] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45aaf8961a9601ece1729608","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45aaf8961a9601ece1729608: done: 0.017682 sec","job_status":"done","queue_duration_s":1.486494,"scheduling_latency_s":1.486512,"redis_calls":13,"redis_duration_s":0.0030620000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00206,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017682,"completed_at":"2026-09-04T07:45:11.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 336.874157] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6477012da80def08e14ee33","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6477012da80def08e14ee33: start","job_status":"start","queue_duration_s":1.5058,"scheduling_latency_s":1.505818}1484gitlab # [ 336.886764] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6477012da80def08e14ee33","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6477012da80def08e14ee33: done: 0.019374 sec","job_status":"done","queue_duration_s":1.5058,"scheduling_latency_s":1.505818,"redis_calls":13,"redis_duration_s":0.00328,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019374,"completed_at":"2026-09-04T07:45:11.120Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 336.926571] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77212399aa1def06e373f809","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77212399aa1def06e373f809: start","job_status":"start","queue_duration_s":1.526923,"scheduling_latency_s":1.526942}1486gitlab # [ 336.939678] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77212399aa1def06e373f809","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77212399aa1def06e373f809: done: 0.018356 sec","job_status":"done","queue_duration_s":1.526923,"scheduling_latency_s":1.526942,"redis_calls":13,"redis_duration_s":0.0031079999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018356,"completed_at":"2026-09-04T07:45:11.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 336.980565] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fa126ef435c1ba0d9765342","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fa126ef435c1ba0d9765342: start","job_status":"start","queue_duration_s":1.547089,"scheduling_latency_s":1.547106}1488gitlab # [ 336.993160] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fa126ef435c1ba0d9765342","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fa126ef435c1ba0d9765342: done: 0.017071 sec","job_status":"done","queue_duration_s":1.547089,"scheduling_latency_s":1.547106,"redis_calls":13,"redis_duration_s":0.0030219999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017071,"completed_at":"2026-09-04T07:45:11.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 337.034632] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf4357e76eec565ce398b4e8","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf4357e76eec565ce398b4e8: start","job_status":"start","queue_duration_s":1.565633,"scheduling_latency_s":1.56565}1490gitlab # [ 337.047424] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf4357e76eec565ce398b4e8","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf4357e76eec565ce398b4e8: done: 0.01596 sec","job_status":"done","queue_duration_s":1.565633,"scheduling_latency_s":1.56565,"redis_calls":13,"redis_duration_s":0.002805,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01596,"completed_at":"2026-09-04T07:45:11.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 337.088755] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbd8f844209c3ade3261aae6","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbd8f844209c3ade3261aae6: start","job_status":"start","queue_duration_s":1.58313,"scheduling_latency_s":1.583147}1492gitlab # [ 337.101536] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbd8f844209c3ade3261aae6","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbd8f844209c3ade3261aae6: done: 0.016167 sec","job_status":"done","queue_duration_s":1.58313,"scheduling_latency_s":1.583147,"redis_calls":13,"redis_duration_s":0.002879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016167,"completed_at":"2026-09-04T07:45:11.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 337.141715] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48ff94a6dd872e63f8b6f96c","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48ff94a6dd872e63f8b6f96c: start","job_status":"start","queue_duration_s":1.6008,"scheduling_latency_s":1.600818}1494gitlab # [ 337.154388] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48ff94a6dd872e63f8b6f96c","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48ff94a6dd872e63f8b6f96c: done: 0.01658 sec","job_status":"done","queue_duration_s":1.6008,"scheduling_latency_s":1.600818,"redis_calls":13,"redis_duration_s":0.0030540000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01658,"completed_at":"2026-09-04T07:45:11.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 337.194117] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4a34075ddc3c8eda47d0f5f","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4a34075ddc3c8eda47d0f5f: start","job_status":"start","queue_duration_s":1.618812,"scheduling_latency_s":1.618829}1496gitlab # [ 337.206523] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4a34075ddc3c8eda47d0f5f","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4a34075ddc3c8eda47d0f5f: done: 0.01749 sec","job_status":"done","queue_duration_s":1.618812,"scheduling_latency_s":1.618829,"redis_calls":13,"redis_duration_s":0.0040149999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00291,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01749,"completed_at":"2026-09-04T07:45:11.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 337.247822] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bb1da199b1f7ef4c2779bc6","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bb1da199b1f7ef4c2779bc6: start","job_status":"start","queue_duration_s":1.637848,"scheduling_latency_s":1.637865}1498gitlab # [ 337.260701] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bb1da199b1f7ef4c2779bc6","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bb1da199b1f7ef4c2779bc6: done: 0.015815 sec","job_status":"done","queue_duration_s":1.637848,"scheduling_latency_s":1.637865,"redis_calls":13,"redis_duration_s":0.002621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001593,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015815,"completed_at":"2026-09-04T07:45:11.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 337.300788] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdc3ae57c1037d70256719bd","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdc3ae57c1037d70256719bd: start","job_status":"start","queue_duration_s":1.655,"scheduling_latency_s":1.655018}1500gitlab # [ 337.313341] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdc3ae57c1037d70256719bd","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdc3ae57c1037d70256719bd: done: 0.017142 sec","job_status":"done","queue_duration_s":1.655,"scheduling_latency_s":1.655018,"redis_calls":13,"redis_duration_s":0.003258,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017142,"completed_at":"2026-09-04T07:45:11.267Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 337.352948] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"005c98d7d59b1f2a3e9bd451","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-005c98d7d59b1f2a3e9bd451: start","job_status":"start","queue_duration_s":1.674218,"scheduling_latency_s":1.674237}1502gitlab # [ 337.365462] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"005c98d7d59b1f2a3e9bd451","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-005c98d7d59b1f2a3e9bd451: done: 0.017419 sec","job_status":"done","queue_duration_s":1.674218,"scheduling_latency_s":1.674237,"redis_calls":13,"redis_duration_s":0.00301,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017419,"completed_at":"2026-09-04T07:45:11.287Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 337.404766] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f910d9e4f396eb99c0ad12a8","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f910d9e4f396eb99c0ad12a8: start","job_status":"start","queue_duration_s":1.693229,"scheduling_latency_s":1.693249}1504gitlab # [ 337.418396] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f910d9e4f396eb99c0ad12a8","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f910d9e4f396eb99c0ad12a8: done: 0.015925 sec","job_status":"done","queue_duration_s":1.693229,"scheduling_latency_s":1.693249,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015925,"completed_at":"2026-09-04T07:45:11.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 337.458196] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acf38ad06199da72473961e3","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acf38ad06199da72473961e3: start","job_status":"start","queue_duration_s":1.710585,"scheduling_latency_s":1.710601}1506gitlab # [ 337.470914] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acf38ad06199da72473961e3","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acf38ad06199da72473961e3: done: 0.016224 sec","job_status":"done","queue_duration_s":1.710585,"scheduling_latency_s":1.710601,"redis_calls":13,"redis_duration_s":0.002956,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016224,"completed_at":"2026-09-04T07:45:11.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 337.510353] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06162712a2c71ef705284204","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06162712a2c71ef705284204: start","job_status":"start","queue_duration_s":1.728729,"scheduling_latency_s":1.728745}1508gitlab # [ 337.522909] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06162712a2c71ef705284204","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06162712a2c71ef705284204: done: 0.018556 sec","job_status":"done","queue_duration_s":1.728729,"scheduling_latency_s":1.728745,"redis_calls":13,"redis_duration_s":0.0032500000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018556,"completed_at":"2026-09-04T07:45:11.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 337.562677] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72a291bdfab6de4760115f01","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72a291bdfab6de4760115f01: start","job_status":"start","queue_duration_s":1.748875,"scheduling_latency_s":1.748894}1510gitlab # [ 337.575338] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72a291bdfab6de4760115f01","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72a291bdfab6de4760115f01: done: 0.017912 sec","job_status":"done","queue_duration_s":1.748875,"scheduling_latency_s":1.748894,"redis_calls":13,"redis_duration_s":0.003099,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017912,"completed_at":"2026-09-04T07:45:11.362Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 337.615124] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7059fb50df46014f2764c0d7","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7059fb50df46014f2764c0d7: start","job_status":"start","queue_duration_s":1.768319,"scheduling_latency_s":1.768337}1512gitlab # [ 337.628893] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7059fb50df46014f2764c0d7","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7059fb50df46014f2764c0d7: done: 0.016907 sec","job_status":"done","queue_duration_s":1.768319,"scheduling_latency_s":1.768337,"redis_calls":13,"redis_duration_s":0.0028250000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016907,"completed_at":"2026-09-04T07:45:11.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 337.667420] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f61fe70276fac18367b81785","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f61fe70276fac18367b81785: start","job_status":"start","queue_duration_s":1.787189,"scheduling_latency_s":1.787206}1514gitlab # [ 337.680025] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f61fe70276fac18367b81785","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f61fe70276fac18367b81785: done: 0.017543 sec","job_status":"done","queue_duration_s":1.787189,"scheduling_latency_s":1.787206,"redis_calls":13,"redis_duration_s":0.003038,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017543,"completed_at":"2026-09-04T07:45:11.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 337.719351] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ed0793c5cd1c77b5f5e6668","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ed0793c5cd1c77b5f5e6668: start","job_status":"start","queue_duration_s":1.806306,"scheduling_latency_s":1.806323}1516gitlab # [ 337.731918] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ed0793c5cd1c77b5f5e6668","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ed0793c5cd1c77b5f5e6668: done: 0.017736 sec","job_status":"done","queue_duration_s":1.806306,"scheduling_latency_s":1.806323,"redis_calls":13,"redis_duration_s":0.0030029999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017736,"completed_at":"2026-09-04T07:45:11.419Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 337.772823] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31472f20e0fe3361e29b5d6e","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31472f20e0fe3361e29b5d6e: start","job_status":"start","queue_duration_s":1.82564,"scheduling_latency_s":1.82566}1518gitlab # [ 337.785195] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31472f20e0fe3361e29b5d6e","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31472f20e0fe3361e29b5d6e: done: 0.019228 sec","job_status":"done","queue_duration_s":1.82564,"scheduling_latency_s":1.82566,"redis_calls":13,"redis_duration_s":0.0038260000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002239,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019228,"completed_at":"2026-09-04T07:45:11.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 337.826514] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a7a312b120e9b87a4b61d7c","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a7a312b120e9b87a4b61d7c: start","job_status":"start","queue_duration_s":1.847897,"scheduling_latency_s":1.847946}1520gitlab # [ 337.839260] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a7a312b120e9b87a4b61d7c","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a7a312b120e9b87a4b61d7c: done: 0.041845 sec","job_status":"done","queue_duration_s":1.847897,"scheduling_latency_s":1.847946,"redis_calls":13,"redis_duration_s":0.004571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002647,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041845,"completed_at":"2026-09-04T07:45:11.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 337.879351] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dd176365317416d46f0d1f6","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dd176365317416d46f0d1f6: start","job_status":"start","queue_duration_s":1.893,"scheduling_latency_s":1.893046}1522gitlab # [ 337.892171] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dd176365317416d46f0d1f6","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dd176365317416d46f0d1f6: done: 0.034476 sec","job_status":"done","queue_duration_s":1.893,"scheduling_latency_s":1.893046,"redis_calls":13,"redis_duration_s":0.003718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001337,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002381,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034476,"completed_at":"2026-09-04T07:45:11.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 337.931899] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f5fd34b334285f9f5391aae","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f5fd34b334285f9f5391aae: start","job_status":"start","queue_duration_s":1.929686,"scheduling_latency_s":1.92972}1524gitlab # [ 337.944500] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f5fd34b334285f9f5391aae","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f5fd34b334285f9f5391aae: done: 0.031931 sec","job_status":"done","queue_duration_s":1.929686,"scheduling_latency_s":1.92972,"redis_calls":13,"redis_duration_s":0.004306,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031931,"completed_at":"2026-09-04T07:45:11.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 337.984749] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa9e324b2747c974784e4be3","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa9e324b2747c974784e4be3: start","job_status":"start","queue_duration_s":1.965097,"scheduling_latency_s":1.965134}1526gitlab # [ 337.997386] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa9e324b2747c974784e4be3","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa9e324b2747c974784e4be3: done: 0.031622 sec","job_status":"done","queue_duration_s":1.965097,"scheduling_latency_s":1.965134,"redis_calls":13,"redis_duration_s":0.004135,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001383,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002752,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031622,"completed_at":"2026-09-04T07:45:11.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 338.038157] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84ace93b82b49b07719439b0","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84ace93b82b49b07719439b0: start","job_status":"start","queue_duration_s":1.999225,"scheduling_latency_s":1.999258}1528gitlab # [ 338.050800] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84ace93b82b49b07719439b0","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84ace93b82b49b07719439b0: done: 0.030256 sec","job_status":"done","queue_duration_s":1.999225,"scheduling_latency_s":1.999258,"redis_calls":13,"redis_duration_s":0.003964,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002583,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030256,"completed_at":"2026-09-04T07:45:11.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 338.091412] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcef7ec31850f97880dbfb2b","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcef7ec31850f97880dbfb2b: start","job_status":"start","queue_duration_s":2.03175,"scheduling_latency_s":2.03178}1530gitlab # [ 338.104275] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcef7ec31850f97880dbfb2b","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcef7ec31850f97880dbfb2b: done: 0.026361 sec","job_status":"done","queue_duration_s":2.03175,"scheduling_latency_s":2.03178,"redis_calls":13,"redis_duration_s":0.004563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001304,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003259,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026361,"completed_at":"2026-09-04T07:45:11.653Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 338.144377] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e669e7da795a88317f0f3bb","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e669e7da795a88317f0f3bb: start","job_status":"start","queue_duration_s":2.060821,"scheduling_latency_s":2.060854}1532gitlab # [ 338.156948] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e669e7da795a88317f0f3bb","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e669e7da795a88317f0f3bb: done: 0.024128 sec","job_status":"done","queue_duration_s":2.060821,"scheduling_latency_s":2.060854,"redis_calls":13,"redis_duration_s":0.003579,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001203,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002376,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024128,"completed_at":"2026-09-04T07:45:11.680Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 338.196879] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c08fe8f931bb93261197d4ae","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c08fe8f931bb93261197d4ae: start","job_status":"start","queue_duration_s":2.086734,"scheduling_latency_s":2.086759}1534gitlab # [ 338.209521] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c08fe8f931bb93261197d4ae","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c08fe8f931bb93261197d4ae: done: 0.018437 sec","job_status":"done","queue_duration_s":2.086734,"scheduling_latency_s":2.086759,"redis_calls":13,"redis_duration_s":0.003016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018437,"completed_at":"2026-09-04T07:45:11.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 338.250863] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a555d8c92bf2fbd3b6c9f28","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a555d8c92bf2fbd3b6c9f28: start","job_status":"start","queue_duration_s":2.106555,"scheduling_latency_s":2.106572}1536gitlab # [ 338.263577] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a555d8c92bf2fbd3b6c9f28","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a555d8c92bf2fbd3b6c9f28: done: 0.016977 sec","job_status":"done","queue_duration_s":2.106555,"scheduling_latency_s":2.106572,"redis_calls":13,"redis_duration_s":0.0028840000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016977,"completed_at":"2026-09-04T07:45:11.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 338.303952] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68e446635fe4d24882b6a1c4","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68e446635fe4d24882b6a1c4: start","job_status":"start","queue_duration_s":2.12503,"scheduling_latency_s":2.125047}1538gitlab # [ 338.316893] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68e446635fe4d24882b6a1c4","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68e446635fe4d24882b6a1c4: done: 0.017159 sec","job_status":"done","queue_duration_s":2.12503,"scheduling_latency_s":2.125047,"redis_calls":13,"redis_duration_s":0.0033829999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017159,"completed_at":"2026-09-04T07:45:11.737Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 338.356996] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b354e53d22e25ef86384d835","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b354e53d22e25ef86384d835: start","job_status":"start","queue_duration_s":2.143718,"scheduling_latency_s":2.143735}1540gitlab # [ 338.369847] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b354e53d22e25ef86384d835","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b354e53d22e25ef86384d835: done: 0.017295 sec","job_status":"done","queue_duration_s":2.143718,"scheduling_latency_s":2.143735,"redis_calls":13,"redis_duration_s":0.003101,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017295,"completed_at":"2026-09-04T07:45:11.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 338.409364] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"119c7d386fe9937580519d7f","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-119c7d386fe9937580519d7f: start","job_status":"start","queue_duration_s":2.162833,"scheduling_latency_s":2.16285}1542gitlab # [ 338.421739] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"119c7d386fe9937580519d7f","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-119c7d386fe9937580519d7f: done: 0.017309 sec","job_status":"done","queue_duration_s":2.162833,"scheduling_latency_s":2.16285,"redis_calls":13,"redis_duration_s":0.0028640000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017309,"completed_at":"2026-09-04T07:45:11.775Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 338.462008] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64a01f46056910f356413191","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64a01f46056910f356413191: start","job_status":"start","queue_duration_s":2.181688,"scheduling_latency_s":2.181704}1544gitlab # [ 338.474439] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64a01f46056910f356413191","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64a01f46056910f356413191: done: 0.017475 sec","job_status":"done","queue_duration_s":2.181688,"scheduling_latency_s":2.181704,"redis_calls":13,"redis_duration_s":0.003077,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00206,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017475,"completed_at":"2026-09-04T07:45:11.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 338.513423] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b9a972884e455cfe86d0c94","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b9a972884e455cfe86d0c94: start","job_status":"start","queue_duration_s":2.200796,"scheduling_latency_s":2.200814}1546gitlab # [ 338.525962] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b9a972884e455cfe86d0c94","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b9a972884e455cfe86d0c94: done: 0.018009 sec","job_status":"done","queue_duration_s":2.200796,"scheduling_latency_s":2.200814,"redis_calls":13,"redis_duration_s":0.0031190000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018009,"completed_at":"2026-09-04T07:45:11.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 338.565257] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f887fe717e2497429702f18","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f887fe717e2497429702f18: start","job_status":"start","queue_duration_s":2.220417,"scheduling_latency_s":2.220435}1548gitlab # [ 338.577776] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f887fe717e2497429702f18","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f887fe717e2497429702f18: done: 0.017853 sec","job_status":"done","queue_duration_s":2.220417,"scheduling_latency_s":2.220435,"redis_calls":13,"redis_duration_s":0.002248,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017853,"completed_at":"2026-09-04T07:45:11.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 338.616708] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e02f14b32747ff83ff676441","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e02f14b32747ff83ff676441: start","job_status":"start","queue_duration_s":2.240101,"scheduling_latency_s":2.240121}1550gitlab # [ 338.629034] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e02f14b32747ff83ff676441","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e02f14b32747ff83ff676441: done: 0.018258 sec","job_status":"done","queue_duration_s":2.240101,"scheduling_latency_s":2.240121,"redis_calls":13,"redis_duration_s":0.002234,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001456,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018258,"completed_at":"2026-09-04T07:45:11.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 338.669150] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60d8466aae72c5ee05dc7527","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60d8466aae72c5ee05dc7527: start","job_status":"start","queue_duration_s":2.25978,"scheduling_latency_s":2.259798}1552gitlab # [ 338.681536] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60d8466aae72c5ee05dc7527","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60d8466aae72c5ee05dc7527: done: 0.018081 sec","job_status":"done","queue_duration_s":2.25978,"scheduling_latency_s":2.259798,"redis_calls":13,"redis_duration_s":0.002111,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001376,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018081,"completed_at":"2026-09-04T07:45:11.873Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 338.720408] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd8a293a04128ccd808500a6","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd8a293a04128ccd808500a6: start","job_status":"start","queue_duration_s":2.280271,"scheduling_latency_s":2.280291}1554gitlab # [ 338.732972] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd8a293a04128ccd808500a6","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd8a293a04128ccd808500a6: done: 0.018161 sec","job_status":"done","queue_duration_s":2.280271,"scheduling_latency_s":2.280291,"redis_calls":13,"redis_duration_s":0.002041,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000762,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018161,"completed_at":"2026-09-04T07:45:11.893Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 338.772091] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be2f3c3865010ac4863d850d","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be2f3c3865010ac4863d850d: start","job_status":"start","queue_duration_s":2.299795,"scheduling_latency_s":2.299812}1556gitlab # [ 338.784338] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be2f3c3865010ac4863d850d","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be2f3c3865010ac4863d850d: done: 0.016345 sec","job_status":"done","queue_duration_s":2.299795,"scheduling_latency_s":2.299812,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016345,"completed_at":"2026-09-04T07:45:11.911Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 338.823364] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abf06fa420255f8a5e59fae1","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abf06fa420255f8a5e59fae1: start","job_status":"start","queue_duration_s":2.317325,"scheduling_latency_s":2.317342}1558gitlab # [ 338.836359] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abf06fa420255f8a5e59fae1","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abf06fa420255f8a5e59fae1: done: 0.015474 sec","job_status":"done","queue_duration_s":2.317325,"scheduling_latency_s":2.317342,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015474,"completed_at":"2026-09-04T07:45:11.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 338.876856] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bde5a67c4bd2a97fcd06669c","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bde5a67c4bd2a97fcd06669c: start","job_status":"start","queue_duration_s":2.333993,"scheduling_latency_s":2.334392}1560gitlab # [ 338.889085] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bde5a67c4bd2a97fcd06669c","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bde5a67c4bd2a97fcd06669c: done: 0.015906 sec","job_status":"done","queue_duration_s":2.333993,"scheduling_latency_s":2.334392,"redis_calls":13,"redis_duration_s":0.001817,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001249,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015906,"completed_at":"2026-09-04T07:45:11.945Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 338.928671] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c671f8295d0ca7f5ded91b2","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c671f8295d0ca7f5ded91b2: start","job_status":"start","queue_duration_s":2.351143,"scheduling_latency_s":2.351161}1562gitlab # [ 338.941111] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c671f8295d0ca7f5ded91b2","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c671f8295d0ca7f5ded91b2: done: 0.01549 sec","job_status":"done","queue_duration_s":2.351143,"scheduling_latency_s":2.351161,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01549,"completed_at":"2026-09-04T07:45:11.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 338.980775] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e8fc9fb1aabb1ffbc4255fd","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e8fc9fb1aabb1ffbc4255fd: start","job_status":"start","queue_duration_s":2.367859,"scheduling_latency_s":2.367877}1564gitlab # [ 338.993240] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e8fc9fb1aabb1ffbc4255fd","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e8fc9fb1aabb1ffbc4255fd: done: 0.015623 sec","job_status":"done","queue_duration_s":2.367859,"scheduling_latency_s":2.367877,"redis_calls":13,"redis_duration_s":0.001627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015623,"completed_at":"2026-09-04T07:45:11.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 339.032631] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c1a8078fa107505010523bd","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c1a8078fa107505010523bd: start","job_status":"start","queue_duration_s":2.384748,"scheduling_latency_s":2.384765}1566gitlab # [ 339.046202] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c1a8078fa107505010523bd","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c1a8078fa107505010523bd: done: 0.016036 sec","job_status":"done","queue_duration_s":2.384748,"scheduling_latency_s":2.384765,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016036,"completed_at":"2026-09-04T07:45:11.996Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 339.085205] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:11.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79a680991db3443460388cbb","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79a680991db3443460388cbb: start","job_status":"start","queue_duration_s":2.40259,"scheduling_latency_s":2.40261}1568gitlab # [ 339.097919] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79a680991db3443460388cbb","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79a680991db3443460388cbb: done: 0.016097 sec","job_status":"done","queue_duration_s":2.40259,"scheduling_latency_s":2.40261,"redis_calls":13,"redis_duration_s":0.001719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016097,"completed_at":"2026-09-04T07:45:12.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 339.137136] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e7bfd35133533854b608002","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e7bfd35133533854b608002: start","job_status":"start","queue_duration_s":2.419975,"scheduling_latency_s":2.419993}1570gitlab # [ 339.149600] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e7bfd35133533854b608002","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e7bfd35133533854b608002: done: 0.017676 sec","job_status":"done","queue_duration_s":2.419975,"scheduling_latency_s":2.419993,"redis_calls":13,"redis_duration_s":0.002365,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017676,"completed_at":"2026-09-04T07:45:12.033Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 339.189792] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a754cbf92687b66d9ae7fb1","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a754cbf92687b66d9ae7fb1: start","job_status":"start","queue_duration_s":2.439059,"scheduling_latency_s":2.439079}1572gitlab # [ 339.202539] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a754cbf92687b66d9ae7fb1","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a754cbf92687b66d9ae7fb1: done: 0.021001 sec","job_status":"done","queue_duration_s":2.439059,"scheduling_latency_s":2.439079,"redis_calls":13,"redis_duration_s":0.002645,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021001,"completed_at":"2026-09-04T07:45:12.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 339.242602] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9281117ceee00efdfc9fb020","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9281117ceee00efdfc9fb020: start","job_status":"start","queue_duration_s":2.461381,"scheduling_latency_s":2.461401}1574gitlab # [ 339.256646] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9281117ceee00efdfc9fb020","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9281117ceee00efdfc9fb020: done: 0.01908 sec","job_status":"done","queue_duration_s":2.461381,"scheduling_latency_s":2.461401,"redis_calls":13,"redis_duration_s":0.002014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001269,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01908,"completed_at":"2026-09-04T07:45:12.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 339.296268] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b90890272db0773b957f51c","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b90890272db0773b957f51c: start","job_status":"start","queue_duration_s":2.481671,"scheduling_latency_s":2.48169}1576gitlab # [ 339.308873] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b90890272db0773b957f51c","created_at":"2026-09-04T07:45:09.312Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-b81bff6b2fb8451a","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9512ab05a625ede7ecf8120e97ec3296","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.595Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b90890272db0773b957f51c: done: 0.018393 sec","job_status":"done","queue_duration_s":2.481671,"scheduling_latency_s":2.48169,"redis_calls":13,"redis_duration_s":0.0016619999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018393,"completed_at":"2026-09-04T07:45:12.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 339.349353] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.096Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e2dd98d84f3255142adc8eca","created_at":"2026-09-04T07:45:09.931Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a6ebbf800b8541ec","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.983Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e2dd98d84f3255142adc8eca: start","job_status":"start","queue_duration_s":2.113731,"scheduling_latency_s":2.113749}1578gitlab # [ 339.362009] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.110Z","message":"No existing merge request to be cleaned up."}1579gitlab # [ 339.363717] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.121Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e2dd98d84f3255142adc8eca","created_at":"2026-09-04T07:45:09.931Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a6ebbf800b8541ec","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.983Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e2dd98d84f3255142adc8eca: done: 0.024229 sec","job_status":"done","queue_duration_s":2.113731,"scheduling_latency_s":2.113749,"redis_calls":10,"redis_duration_s":0.001412,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024229,"completed_at":"2026-09-04T07:45:12.121Z","load_balancing_strategy":"primary","db_duration_s":0.003772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 339.403678] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.122Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a5074e51b21d9e87b7244a3f","created_at":"2026-09-04T07:45:09.931Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a6ebbf800b8541ec","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.983Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a5074e51b21d9e87b7244a3f: start","job_status":"start","queue_duration_s":2.139136,"scheduling_latency_s":2.139154}1581gitlab # [ 339.416421] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.135Z","message":"No existing merge request to be cleaned up."}1582gitlab # [ 339.418122] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.145Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a5074e51b21d9e87b7244a3f","created_at":"2026-09-04T07:45:09.931Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a6ebbf800b8541ec","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.983Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a5074e51b21d9e87b7244a3f: done: 0.023161 sec","job_status":"done","queue_duration_s":2.139136,"scheduling_latency_s":2.139154,"redis_calls":10,"redis_duration_s":0.0015,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000838,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023161,"completed_at":"2026-09-04T07:45:12.145Z","load_balancing_strategy":"primary","db_duration_s":0.002736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 339.458118] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.146Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5e562815386b2820886d459f","created_at":"2026-09-04T07:45:09.931Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a6ebbf800b8541ec","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.983Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5e562815386b2820886d459f: start","job_status":"start","queue_duration_s":2.163623,"scheduling_latency_s":2.163641}1584gitlab # [ 339.470773] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.163Z","message":"No existing merge request to be cleaned up."}1585gitlab # [ 339.472485] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.172Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5e562815386b2820886d459f","created_at":"2026-09-04T07:45:09.931Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a6ebbf800b8541ec","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.983Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5e562815386b2820886d459f: done: 0.025876 sec","job_status":"done","queue_duration_s":2.163623,"scheduling_latency_s":2.163641,"redis_calls":10,"redis_duration_s":0.001703,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025876,"completed_at":"2026-09-04T07:45:12.172Z","load_balancing_strategy":"primary","db_duration_s":0.006388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 339.511718] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.174Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bd440b486baf715eab27ad02","created_at":"2026-09-04T07:45:09.931Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a6ebbf800b8541ec","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.983Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bd440b486baf715eab27ad02: start","job_status":"start","queue_duration_s":2.190884,"scheduling_latency_s":2.190905}1587gitlab # [ 339.524627] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.185Z","message":"No existing merge request to be cleaned up."}1588gitlab # [ 339.526366] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:12.194Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bd440b486baf715eab27ad02","created_at":"2026-09-04T07:45:09.931Z","trace_propagation_headers":{"sentry-trace":"a80aac782854483da78e8bc5efc6b7d7-a6ebbf800b8541ec","baggage":"sentry-trace_id=a80aac782854483da78e8bc5efc6b7d7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2dce943cfee8ee8fdfbff503cc477720","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.983Z","job_size_bytes":2,"pid":2292,"sidekiq_tid":"m7q4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bd440b486baf715eab27ad02: done: 0.020853 sec","job_status":"done","queue_duration_s":2.190884,"scheduling_latency_s":2.190905,"redis_calls":10,"redis_duration_s":0.0016719999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020853,"completed_at":"2026-09-04T07:45:12.194Z","load_balancing_strategy":"primary","db_duration_s":0.002646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 375.475782] postgres[3703]: [3703] ERROR: relation "table_without_models" does not exist1590gitlab # [ 375.479708] postgres[3703]: [3703] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1591gitlab # [ 381.825806] runuser[3334]: pam_unix(runuser:session): session closed for user gitlab1592gitlab # [ 381.827631] setup-gitlab-start[3303]: + systemctl restart gitlab-sidekiq.service1593gitlab # [ 381.870157] systemd[1]: Stopping gitlab-sidekiq.service...1594gitlab # [ 381.873604] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:56.454Z","message":"Shutting down"}1595gitlab # [ 381.877500] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:56.455Z","message":"Scheduler exiting..."}1596gitlab # [ 381.881450] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:56.456Z","message":"Terminating quiet threads for default capsule"}1597gitlab # [ 381.886022] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:56.456Z","message":"Scheduler exiting..."}1598gitlab # [ 382.373505] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:56.958Z","message":"Pausing to allow jobs to finish..."}1599gitlab # [ 383.377843] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:57.961Z","message":"Bye!"}1600gitlab # [ 383.419246] sidekiq-cluster[2292]: {"severity":"INFO","time":"2026-09-04T07:45:58.004Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2292,"worker_id":"sidekiq_0","memwd_rss_bytes":924368896,"retry":0}1601gitlab # [ 384.357412] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1602gitlab # [ 384.357865] systemd[1]: Stopped gitlab-sidekiq.service.1603gitlab # [ 384.358109] systemd[1]: gitlab-sidekiq.service: Consumed 2min 14.379s CPU time over 3min 46.850s wall clock time, 934.6M memory peak, 4.5M read from disk.1604gitlab # [ 384.371690] systemd[1]: Started gitlab-sidekiq.service.1605gitlab # [ 384.376536] setup-gitlab-start[3303]: + mkdir -p /var/lib/secrets1606gitlab # [ 384.381525] setup-gitlab-start[3303]: + echo nixbot-test-token-of-20-chars1607gitlab # [ 384.384689] setup-gitlab-start[3303]: + chmod 644 /var/lib/secrets/gitlab-token1608gitlab # [ 384.387653] setup-gitlab-start[3303]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1609gitlab # [ 385.820516] gitaly[1041]: time="2026-09-04T07:46:00.404Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:10.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:00.403" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1610gitlab # [ 385.828739] gitaly[1041]: time="2026-09-04T07:46:00.406Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:10.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:00.403" grpc.time_ms=1.649 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1611gitlab # [ 386.083852] gitaly[1041]: time="2026-09-04T07:46:00.669Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:10.277" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:00.668" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1612gitlab # [ 386.143225] gitaly[1041]: time="2026-09-04T07:46:00.669Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:10.277" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:00.668" grpc.time_ms=0.833 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1613gitlab # [ 386.234223] gitaly[1041]: time="2026-09-04T07:46:00.819Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ diskcache=5277aacf-78df-420b-9a50-8c2d826d747b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:46:10.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:00.745" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 386.264915] gitaly[1041]: time="2026-09-04T07:46:00.820Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=41 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=47 command.spawn_token_fork_ms=6 command.system_time_ms=41 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:46:10.004" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:00.745" grpc.time_ms=74.259 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 386.293783] gitaly[1041]: time="2026-09-04T07:46:00.848Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:10.106" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:00.847" pid=1041 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1616gitlab # [ 386.310341] gitaly[1041]: time="2026-09-04T07:46:00.849Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:10.106" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:00.847" grpc.time_ms=1.598 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 386.326520] gitaly[1041]: time="2026-09-04T07:46:00.880Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:46:10.119" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:00.860" grpc.time_ms=19.658 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 386.424949] gitaly[1041]: time="2026-09-04T07:46:01.010Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:11.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:01.009" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 386.456054] gitaly[1041]: time="2026-09-04T07:46:01.010Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:11.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:01.009" grpc.time_ms=0.664 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 386.490031] gitaly[1041]: time="2026-09-04T07:46:01.057Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ diskcache=f81f750d-f862-4c99-ad24-2851dc597dfa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:46:11.013" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:01.014" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 386.511595] gitaly[1041]: time="2026-09-04T07:46:01.058Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:46:11.013" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:01.014" grpc.time_ms=42.963 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 386.532784] gitaly[1041]: time="2026-09-04T07:46:01.072Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:11.071" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:01.071" pid=1041 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1623gitlab # [ 386.546156] gitaly[1041]: time="2026-09-04T07:46:01.073Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:11.071" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:01.071" grpc.time_ms=0.909 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1624gitlab # [ 386.558790] gitaly[1041]: time="2026-09-04T07:46:01.095Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=9 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:46:11.080" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:01.081" grpc.time_ms=14.095 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1625gitlab # [ 386.581638] gitaly[1041]: time="2026-09-04T07:46:01.167Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:46:11.165" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:01.166" grpc.time_ms=0.601 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1626gitlab # [ 386.603947] gitaly[1041]: time="2026-09-04T07:46:01.189Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:46:11.187" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:01.188" grpc.time_ms=0.674 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 387.649473] gitaly[1041]: time="2026-09-04T07:46:02.233Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3BPTYEH336GWQ2M0Q3WJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:46:12.213" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:02.214" grpc.time_ms=19.45 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1628gitlab # [ 388.187982] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:02 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 37691629gitlab # [ 388.196165] setup-gitlab-start[3303]: + mkdir -p /tmp/test-flake1630gitlab # [ 388.200219] setup-gitlab-start[3303]: + cd /tmp/test-flake1631gitlab # [ 388.202877] setup-gitlab-start[3303]: + git init -b master1632gitlab # [ 388.230520] setup-gitlab-start[3826]: Initialized empty Git repository in /tmp/test-flake/.git/1633gitlab # [ 388.234154] setup-gitlab-start[3303]: + git config user.name test1634gitlab # [ 388.236780] setup-gitlab-start[3303]: + git config user.email test@example.com1635gitlab # [ 388.239790] setup-gitlab-start[3303]: + cat1636gitlab # [ 388.242821] setup-gitlab-start[3303]: + git add flake.nix1637gitlab # [ 388.247866] setup-gitlab-start[3303]: + git commit -m 'initial commit'1638gitlab # [ 388.283935] setup-gitlab-start[3831]: [master (root-commit) 1eaaf33] initial commit1639gitlab # [ 388.287143] setup-gitlab-start[3831]: 1 file changed, 10 insertions(+)1640gitlab # [ 388.291108] setup-gitlab-start[3831]: create mode 100644 flake.nix1641gitlab # [ 388.293922] setup-gitlab-start[3303]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1642gitlab # [ 388.303089] setup-gitlab-start[3303]: + git push -u origin master1643gitlab # [ 388.443241] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 871644gitlab # [ 388.642790] gitaly[1041]: time="2026-09-04T07:46:03.228Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FMPG3GBHAVFBF3Q97DJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:03.211" grpc.time_ms=16.816 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1645gitlab # [ 388.663331] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1981646gitlab # [ 389.076751] gitaly[1041]: time="2026-09-04T07:46:03.660Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:46:13.251" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:03.642" grpc.time_ms=18.221 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 389.151662] gitaly[1041]: time="2026-09-04T07:46:03.736Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:46:33.017" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:46:03.717" grpc.time_ms=18.888 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1648gitlab # [ 389.194109] gitaly[1041]: time="2026-09-04T07:46:03.779Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M duration_ms=299ns method=POST pid=1041 status=200 url="http://unix/api/v4/internal/allowed"1649gitlab # [ 389.525517] gitaly[1041]: time="2026-09-04T07:46:04.109Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M duration_ms=329ns method=POST pid=1041 status=200 url="http://unix/api/v4/internal/pre_receive"1650gitlab # [ 389.540133] gitaly[1041]: time="2026-09-04T07:46:04.110Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:03.473" grpc.time_ms=637.636 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1651gitlab # [ 389.621625] gitaly[1041]: time="2026-09-04T07:46:04.206Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:04.204" grpc.time_ms=1.944 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1652gitlab # [ 389.715903] gitaly[1041]: time="2026-09-04T07:46:04.301Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:04.299" grpc.time_ms=1.239 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1653gitlab # [ 389.793481] gitaly[1041]: time="2026-09-04T07:46:04.378Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:04.377" grpc.time_ms=1.037 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1654gitlab # [ 390.132556] sidekiq-cluster[3770]: {"severity":"INFO","time":"2026-09-04T07:46:04.665Z","message":"Starting cluster with 1 processes"}1655gitlab # [ 390.469351] gitaly[1041]: time="2026-09-04T07:46:05.053Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:46:15.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:05.042" grpc.time_ms=10.556 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 390.559729] gitaly[1041]: time="2026-09-04T07:46:05.144Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=5 command.system_time_ms=24 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:46:15.062" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:05.103" grpc.time_ms=40.792 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 390.598127] gitaly[1041]: time="2026-09-04T07:46:05.180Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M duration_ms=747ns method=POST pid=1041 status=200 url="http://unix/api/v4/internal/post_receive"1658gitlab # [ 390.604195] gitaly[1041]: time="2026-09-04T07:46:05.181Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:04.428" grpc.time_ms=753.171 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1659gitlab # [ 390.631828] gitaly[1041]: time="2026-09-04T07:46:05.192Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M diskcache=c4320a4d-043b-4e90-970f-e36f4d86c88f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:03.351" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1660gitlab # [ 390.652262] systemd[1]: Finished setup-gitlab.service.1661gitlab # [ 390.654029] gitlab-workhorse[862]: time="2026-09-04T07:46:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521662gitlab # [ 390.657110] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:05 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 19411663gitlab # [ 390.660328] setup-gitlab-start[3835]: To http://gitlab/root/test-flake.git1664gitlab # [ 390.661736] setup-gitlab-start[3835]: * [new branch] master -> master1665gitlab # [ 390.663074] setup-gitlab-start[3835]: branch 'master' set up to track 'origin/master'.1666gitlab # [ 390.664649] gitaly[1041]: time="2026-09-04T07:46:05.193Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=383 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13842 command.oublock=32 command.real_time_ms=1833 command.spawn_token_fork_ms=1 command.system_time_ms=211 command.user_time_ms=172 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:03.351" grpc.time_ms=1841.765 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1667gitlab # [ 390.682591] systemd[1]: Starting nixbot CI service...1668gitlab: (finished: waiting for unit setup-gitlab.service, in 391.77 seconds)1669gitlab: waiting for unit nixbot.service1670gitlab # [ 392.031121] nixbot[3929]: {"ts": "2026-09-04T07:46:06.615Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1671gitlab # [ 392.074994] nixbot[3929]: {"ts": "2026-09-04T07:46:06.660Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1672gitlab # [ 392.116373] nixbot[3929]: {"ts": "2026-09-04T07:46:06.701Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1673gitlab # [ 392.123724] nixbot[3929]: {"ts": "2026-09-04T07:46:06.709Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1674gitlab # [ 392.131921] nixbot[3929]: {"ts": "2026-09-04T07:46:06.715Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1675gitlab # [ 392.141315] nixbot[3929]: {"ts": "2026-09-04T07:46:06.726Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1676gitlab # [ 392.148637] nixbot[3929]: {"ts": "2026-09-04T07:46:06.733Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1677gitlab # [ 392.155247] nixbot[3929]: {"ts": "2026-09-04T07:46:06.737Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1678gitlab # [ 392.162019] nixbot[3929]: {"ts": "2026-09-04T07:46:06.746Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1679gitlab # [ 392.168658] nixbot[3929]: {"ts": "2026-09-04T07:46:06.750Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1680gitlab # [ 392.175055] nixbot[3929]: {"ts": "2026-09-04T07:46:06.758Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1681gitlab # [ 392.183195] nixbot[3929]: {"ts": "2026-09-04T07:46:06.768Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1682gitlab # [ 392.188804] nixbot[3929]: {"ts": "2026-09-04T07:46:06.773Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1683gitlab # [ 392.194389] nixbot[3929]: {"ts": "2026-09-04T07:46:06.776Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1684gitlab # [ 392.200291] nixbot[3929]: {"ts": "2026-09-04T07:46:06.782Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1685gitlab # [ 392.206637] nixbot[3929]: {"ts": "2026-09-04T07:46:06.785Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1686gitlab # [ 392.212238] nixbot[3929]: {"ts": "2026-09-04T07:46:06.788Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1687gitlab # [ 392.217616] nixbot[3929]: {"ts": "2026-09-04T07:46:06.791Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1688gitlab # [ 392.222544] nixbot[3929]: {"ts": "2026-09-04T07:46:06.798Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1689gitlab # [ 392.227438] nixbot[3929]: {"ts": "2026-09-04T07:46:06.801Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1690gitlab # [ 392.232482] nixbot[3929]: {"ts": "2026-09-04T07:46:06.803Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1691gitlab # [ 392.237206] nixbot[3929]: {"ts": "2026-09-04T07:46:06.811Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1692gitlab # [ 392.242147] nixbot[3929]: {"ts": "2026-09-04T07:46:06.814Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1693gitlab # [ 392.246780] nixbot[3929]: {"ts": "2026-09-04T07:46:06.817Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1694gitlab # [ 392.251048] nixbot[3929]: {"ts": "2026-09-04T07:46:06.819Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1695gitlab # [ 392.255364] nixbot[3929]: {"ts": "2026-09-04T07:46:06.822Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1696gitlab # [ 392.259588] nixbot[3929]: {"ts": "2026-09-04T07:46:06.825Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1697gitlab # [ 392.263586] nixbot[3929]: {"ts": "2026-09-04T07:46:06.827Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1698gitlab # [ 392.267502] nixbot[3929]: {"ts": "2026-09-04T07:46:06.830Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1699gitlab # [ 392.271484] nixbot[3929]: {"ts": "2026-09-04T07:46:06.846Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1700gitlab # [ 392.275375] nixbot[3929]: {"ts": "2026-09-04T07:46:06.853Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1701gitlab # [ 392.832646] nixbot[3929]: INFO: Started server process [3929]1702gitlab # [ 392.835485] nixbot[3929]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1703gitlab # [ 392.864243] nixbot[3929]: INFO: ::ffff:127.0.0.1:60506 - "GET /health HTTP/1.1" 200 OK1704gitlab # [ 392.872206] systemd[1]: Started nixbot CI service.1705gitlab # [ 392.877368] systemd[1]: Reached target Multi-User System.1706gitlab # [ 392.879868] systemd[1]: Startup finished in 1.021s (kernel) + 5.130s (initrd) + 6min 26.725s (userspace) = 6min 32.877s.1707gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds)1708gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1709gitlab # [ 393.465412] nixbot[3929]: INFO: ::ffff:127.0.0.1:60514 - "GET /health HTTP/1.1" 200 OK1710gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1711subtest: project discovered and webhook registered1712gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1713gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds)1714gitlab # [ 393.652469] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1251715gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1716gitlab # [ 394.823019] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1191717gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds)1718gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1719gitlab # [ 396.022761] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1361720gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.20 seconds)1721gitlab # [ 396.668188] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:11 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 38011722gitlab # [ 396.677621] nixbot[3929]: {"ts": "2026-09-04T07:46:11.261Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1723gitlab # [ 396.704047] nixbot[3929]: {"ts": "2026-09-04T07:46:11.289Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1724gitlab # [ 396.842747] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1261725gitlab # [ 396.860478] nixbot[3929]: {"ts": "2026-09-04T07:46:11.436Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1726gitlab # [ 396.867647] nixbot[3929]: {"ts": "2026-09-04T07:46:11.440Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1727gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1728gitlab # [ 397.130593] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 2681729gitlab # [ 397.144128] nixbot[3929]: {"ts": "2026-09-04T07:46:11.724Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1730gitlab # [ 397.252978] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 1721731gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.23 seconds)1732(finished: subtest: project discovered and webhook registered, in 3.79 seconds)1733subtest: push delivers the webhook1734gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1735gitlab # [ 397.401017] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:11 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 541736gitlab # [ 397.424137] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:12 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2581737gitlab # [ 397.427498] nixbot[3929]: {"ts": "2026-09-04T07:46:12.010Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1738gitlab # [ 397.528253] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 791739gitlab # [ 397.530476] nixbot[3929]: {"ts": "2026-09-04T07:46:12.115Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1740gitlab # [ 397.540348] gitaly[1041]: time="2026-09-04T07:46:12.125Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=10 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RCPACS4GSZEZ17TPF40 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.108" grpc.time_ms=16.728 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1741gitlab # [ 397.558029] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:12 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 1341742gitlab # Enumerating objects: 5, done.1743gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1744gitlab # Delta compression using up to 4 threads1745gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1746gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 54.00 KiB/s, done.1747gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1748gitlab # [ 397.640116] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:12 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 921749gitlab # [ 397.642345] nixbot[3929]: {"ts": "2026-09-04T07:46:12.227Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1750gitlab # [ 397.739030] gitaly[1041]: time="2026-09-04T07:46:12.324Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3RMAXRFD317CM5GAR440 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-04T07:46:42.001" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:12.302" grpc.time_ms=21.534 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751gitlab # [ 397.764811] gitaly[1041]: time="2026-09-04T07:46:12.350Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3RMAXRFD317CM5GAR440 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:42.047" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:12.348" grpc.time_ms=1.228 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1752gitlab # [ 397.790884] gitaly[1041]: time="2026-09-04T07:46:12.374Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=11 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3RMAXRFD317CM5GAR440 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-04T07:46:22.004" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:12.355" grpc.time_ms=19.063 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1753gitlab # [ 397.848588] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1991754gitlab # [ 397.853254] nixbot[3929]: {"ts": "2026-09-04T07:46:12.437Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1755gitlab # [ 397.974674] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1181756gitlab # [ 397.982471] nixbot[3929]: {"ts": "2026-09-04T07:46:12.561Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1757gitlab # [ 397.992244] nixbot[3929]: {"ts": "2026-09-04T07:46:12.564Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1758gitlab # [ 398.078481] gitaly[1041]: time="2026-09-04T07:46:12.663Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:46:42.042" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:46:12.643" grpc.time_ms=20.616 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 398.117818] gitaly[1041]: time="2026-09-04T07:46:12.702Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3S0AE7MAH9C8N1B75CZP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.694" grpc.time_ms=8.589 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1760gitlab # [ 398.131061] gitaly[1041]: time="2026-09-04T07:46:12.705Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C duration_ms=342ns method=POST pid=1041 status=200 url="http://unix/api/v4/internal/allowed"1761gitlab # [ 398.134397] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 851762gitlab # [ 398.157749] gitaly[1041]: time="2026-09-04T07:46:12.743Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C duration_ms=37ns method=POST pid=1041 status=200 url="http://unix/api/v4/internal/pre_receive"1763gitlab # [ 398.161237] gitaly[1041]: time="2026-09-04T07:46:12.743Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5322 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:12.361" grpc.time_ms=382.031 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1764gitlab # [ 398.200307] gitaly[1041]: time="2026-09-04T07:46:12.785Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:12.784" grpc.time_ms=1.131 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1765gitlab # [ 398.243141] gitaly[1041]: time="2026-09-04T07:46:12.828Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:12.826" grpc.time_ms=1.538 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1766gitlab # [ 398.281330] gitaly[1041]: time="2026-09-04T07:46:12.866Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4793 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:12.866" grpc.time_ms=0.464 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1767gitlab # [ 398.301997] gitaly[1041]: time="2026-09-04T07:46:12.887Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3S36TGGXS19FCF9JM1B8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.875" pid=1041 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1768gitlab # [ 398.316466] gitaly[1041]: time="2026-09-04T07:46:12.887Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3S36TGGXS19FCF9JM1B8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.875" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1769gitlab # [ 398.329780] gitlab-workhorse[862]: time="2026-09-04T07:46:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131770gitlab # [ 398.331587] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1781771gitlab # [ 398.333571] gitaly[1041]: time="2026-09-04T07:46:12.888Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3S36TGGXS19FCF9JM1B8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.875" grpc.time_ms=12.472 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1772gitlab # [ 398.379434] gitaly[1041]: time="2026-09-04T07:46:12.964Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C duration_ms=61ns method=POST pid=1041 status=200 url="http://unix/api/v4/internal/post_receive"1773gitlab # [ 398.384354] gitaly[1041]: time="2026-09-04T07:46:12.966Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4816 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:12.902" grpc.time_ms=63.051 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1774gitlab # [ 398.398128] gitaly[1041]: time="2026-09-04T07:46:12.983Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C diskcache=585b757d-0e3a-4c8b-bf65-55cd4a7fd758 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.284" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1775gitlab # [ 398.408220] gitaly[1041]: time="2026-09-04T07:46:12.983Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=179 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=827392 command.minflt=13674 command.oublock=32 command.real_time_ms=685 command.spawn_token_fork_ms=5 command.system_time_ms=100 command.user_time_ms=79 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.284" grpc.time_ms=699.045 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1776gitlab # To http://gitlab/root/test-flake.git1777gitlab # [ 398.421469] gitlab-workhorse[862]: time="2026-09-04T07:46:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521778gitlab # 1eaaf33..0e4246f [ 398.423873] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:12 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8091779gitlab # master -> master1780gitlab # [ 398.427858] gitaly[1041]: time="2026-09-04T07:46:13.013Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3S97BGR8DHD080B4HNF5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.985" pid=1041 remote_ip="2001:db8:1::1" request_sha=18f48c72a868cfe47cd8498cb1e654d3dd7ceb6a response_bytes=419 span.kind=server system=grpc1781gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.19 seconds)1782gitlab: must succeed: git -C /tmp/test-flake rev-parse master1783gitlab # [ 398.438351] gitaly[1041]: time="2026-09-04T07:46:13.013Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3S97BGR8DHD080B4HNF5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.985" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1784gitlab # [ 398.451788] gitlab-workhorse[862]: time="2026-09-04T07:46:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4191785gitlab # [ 398.453696] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 419 "" "git/2.55.0" 1101786gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1787gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1788gitlab # [ 398.455495] gitaly[1041]: time="2026-09-04T07:46:13.013Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3S97BGR8DHD080B4HNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:12.985" grpc.time_ms=27.845 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1789gitlab # [ 398.549677] gitaly[1041]: time="2026-09-04T07:46:13.134Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=13 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SDZNS7H45QDN0AGEJ4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:13.115" grpc.time_ms=18.901 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1790gitlab # [ 398.564562] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 781791gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.10 seconds)1792gitlab # [ 398.566909] nixbot[3929]: INFO: ::ffff:127.0.0.1:60516 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1793gitlab # [ 398.657810] gitaly[1041]: time="2026-09-04T07:46:13.243Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SGQZDFB57MGA1AMY0TQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:13.224" pid=1041 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1794gitlab # [ 398.686254] gitaly[1041]: time="2026-09-04T07:46:13.243Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SGQZDFB57MGA1AMY0TQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:13.224" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1795gitlab # [ 398.716146] gitlab-workhorse[862]: time="2026-09-04T07:46:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671796gitlab # [ 398.719472] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1011797gitlab # [ 398.722887] gitaly[1041]: time="2026-09-04T07:46:13.243Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SGQZDFB57MGA1AMY0TQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:13.224" grpc.time_ms=18.734 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1798gitlab # [ 398.807313] gitaly[1041]: time="2026-09-04T07:46:13.392Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SNT4QYQBGYHZCMVMDKH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:13.375" grpc.time_ms=17.299 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1799gitlab # [ 398.843042] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 861800gitlab # [ 398.908365] gitaly[1041]: time="2026-09-04T07:46:13.493Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SRMCTHEWNKSY4Z3N4CM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:13.464" pid=1041 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1801gitlab # [ 398.939559] gitaly[1041]: time="2026-09-04T07:46:13.493Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1105 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SRMCTHEWNKSY4Z3N4CM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:13.464" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1802gitlab # [ 398.973902] gitlab-workhorse[862]: time="2026-09-04T07:46:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091803gitlab # [ 398.977802] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 991804gitlab # [ 398.982247] gitaly[1041]: time="2026-09-04T07:46:13.497Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1105 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SRMCTHEWNKSY4Z3N4CM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:13.464" grpc.time_ms=29.798 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1805gitlab # [ 399.173026] gitaly[1041]: time="2026-09-04T07:46:13.758Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:43.455" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:13.756" grpc.time_ms=1.612 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 399.283886] gitaly[1041]: time="2026-09-04T07:46:13.869Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:46:43.546" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:13.847" grpc.time_ms=21.736 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 399.373946] gitaly[1041]: time="2026-09-04T07:46:13.959Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:23.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:13.939" grpc.time_ms=19.86 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 399.421709] gitaly[1041]: time="2026-09-04T07:46:14.007Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:23.054" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:13.984" grpc.time_ms=21.955 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1810gitlab # [ 399.620210] gitaly[1041]: time="2026-09-04T07:46:14.204Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:46:24.162" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:14.203" grpc.time_ms=0.937 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 399.665100] nixbot[3929]: INFO: ::ffff:127.0.0.1:60522 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1812gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.11 seconds)1813gitlab # [ 399.684632] gitaly[1041]: time="2026-09-04T07:46:14.270Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:46:24.213" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:14.254" grpc.time_ms=15.241 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 399.764617] gitaly[1041]: time="2026-09-04T07:46:14.349Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:14.348" grpc.time_ms=1.186 pid=1041 span.kind=server system=grpc1815gitlab # [ 399.827904] gitaly[1041]: time="2026-09-04T07:46:14.413Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:46:14.412" grpc.time_ms=1.019 pid=1041 span.kind=server system=grpc1816gitlab # [ 399.857859] gitaly[1041]: time="2026-09-04T07:46:14.432Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 diskcache=f69fb142-2a15-4da8-9948-e41d4d0c73ec grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:46:24.235" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:14.275" pid=1041 ref=refs/keep-around/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 remote_ip="2001:db8:1::1" revision=1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 span.kind=server system=grpc username=root1817gitlab # [ 399.884255] gitaly[1041]: time="2026-09-04T07:46:14.432Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=143 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5480 command.oublock=8 command.real_time_ms=146 command.spawn_token_fork_ms=2 command.system_time_ms=91 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:46:24.235" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:14.275" grpc.time_ms=156.562 pid=1041 ref=refs/keep-around/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 remote_ip="2001:db8:1::1" revision=1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 span.kind=server system=grpc username=root1818gitlab # [ 399.907583] gitaly[1041]: time="2026-09-04T07:46:14.441Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:44.138" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:14.439" grpc.time_ms=1.112 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 400.283987] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 12491820gitlab # [ 400.292233] nixbot[3929]: {"ts": "2026-09-04T07:46:14.870Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 \"HTTP/1.1 201 Created\""}1821gitlab # [ 400.301024] nixbot[3929]: {"ts": "2026-09-04T07:46:14.885Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-1eaaf3383cd0-0"}1822gitlab # [ 400.629339] nixbot[3929]: {"ts": "2026-09-04T07:46:15.214Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1eaaf3383cd0-0", "argv0": "bwrap"}1823gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1824gitlab # [ 400.735602] nixbot[3929]: INFO: ::ffff:127.0.0.1:60528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.07 seconds)1826gitlab # [ 400.812541] systemd[1]: Started Nix Daemon.1827gitlab # [ 400.925568] nix-daemon[4173]: accepted connection from pid 4168, user nixbot1828gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1829gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1830gitlab # [ 401.798456] nixbot[3929]: INFO: ::ffff:127.0.0.1:34606 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1831gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1832gitlab # [ 402.853595] nixbot[3929]: INFO: ::ffff:127.0.0.1:34620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1833gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1834gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1835gitlab # [ 403.911959] nixbot[3929]: INFO: ::ffff:127.0.0.1:34626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1836gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1837gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1838gitlab # [ 404.969440] nixbot[3929]: INFO: ::ffff:127.0.0.1:34630 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1839gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1840gitlab # [ 405.743120] nix-daemon[4173]: accepted connection from pid 4196, user nixbot1841gitlab # [ 405.765845] nix-daemon[4173]: accepted connection from pid 4168, user nixbot1842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1844gitlab # [ 406.032748] nixbot[3929]: INFO: ::ffff:127.0.0.1:34642 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1845gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1846gitlab # [ 407.095952] nixbot[3929]: INFO: ::ffff:127.0.0.1:34652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1847gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1848gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1849gitlab # [ 408.159959] nixbot[3929]: INFO: ::ffff:127.0.0.1:34668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1850gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1851gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1852gitlab # [ 409.261972] nixbot[3929]: INFO: ::ffff:127.0.0.1:34670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1853gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.10 seconds)1854gitlab # [ 410.217016] nix-daemon[4173]: accepted connection from pid 4168, user nixbot1855gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1856gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.07 seconds)1857gitlab # [ 410.327225] nixbot[3929]: INFO: ::ffff:127.0.0.1:34674 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1858gitlab # [ 410.490892] gitaly[1041]: time="2026-09-04T07:46:25.074Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP4519T68V06DX8HW8NNXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:55.070" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:25.072" grpc.time_ms=2.343 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1859gitlab # [ 410.584198] gitaly[1041]: time="2026-09-04T07:46:25.169Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP4519T68V06DX8HW8NNXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:35.107" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:25.147" grpc.time_ms=21.461 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860gitlab # [ 410.811996] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 4581861gitlab # [ 410.818996] nixbot[3929]: {"ts": "2026-09-04T07:46:25.399Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 \"HTTP/1.1 201 Created\""}1862gitlab # [ 410.958018] gitaly[1041]: time="2026-09-04T07:46:25.543Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP45G2BPE3JX4GSQ6EJG27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:55.240" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:25.541" grpc.time_ms=1.625 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 411.033645] gitaly[1041]: time="2026-09-04T07:46:25.619Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP45G2BPE3JX4GSQ6EJG27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:35.250" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:25.601" grpc.time_ms=17.564 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1864gitlab # [ 411.220904] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3951865gitlab # [ 411.229287] nixbot[3929]: {"ts": "2026-09-04T07:46:25.807Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 \"HTTP/1.1 201 Created\""}1866gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1867gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.09 seconds)1868gitlab # [ 411.393147] gitaly[1041]: time="2026-09-04T07:46:25.978Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP45XNS11AR10T1BG4TDFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:55.675" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:25.976" grpc.time_ms=1.287 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab # [ 411.431367] nixbot[3929]: INFO: ::ffff:127.0.0.1:54826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1870gitlab # [ 411.517939] gitaly[1041]: time="2026-09-04T07:46:26.100Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=4 command.system_time_ms=20 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP45XNS11AR10T1BG4TDFG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:36.025" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:26.067" grpc.time_ms=32.668 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 411.700345] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 4361872gitlab # [ 411.707662] nixbot[3929]: {"ts": "2026-09-04T07:46:26.286Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 \"HTTP/1.1 201 Created\""}1873gitlab # [ 412.361475] gitaly[1041]: time="2026-09-04T07:46:26.946Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NP46VFD076JJHR29Y5B1D0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:26.926" grpc.time_ms=19.727 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1874gitlab # [ 412.381218] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1491875gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1876gitlab # [ 412.492911] nixbot[3929]: INFO: ::ffff:127.0.0.1:54842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1877gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.07 seconds)1878gitlab # [ 412.585790] gitaly[1041]: time="2026-09-04T07:46:27.167Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP47081725QERPHC6QMSAX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:27.131" pid=1041 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1879gitlab # [ 412.616706] gitaly[1041]: time="2026-09-04T07:46:27.186Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=3 command.system_time_ms=23 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP47081725QERPHC6QMSAX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:27.131" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1880gitlab # [ 412.644210] gitlab-workhorse[862]: time="2026-09-04T07:46:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671881gitlab # [ 412.647303] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2341882gitlab # [ 412.650879] gitaly[1041]: time="2026-09-04T07:46:27.187Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=3 command.system_time_ms=23 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP47081725QERPHC6QMSAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:27.131" grpc.time_ms=55.169 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1883gitlab # [ 412.850234] gitaly[1041]: time="2026-09-04T07:46:27.435Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=5 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP47A2XXPNYZJVE25N9XAT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:27.408" grpc.time_ms=27.427 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1884gitlab # [ 412.874571] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1691885gitlab # [ 413.019109] gitaly[1041]: time="2026-09-04T07:46:27.604Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP47FG5SKDXP1R7VQ35H9Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:27.577" pid=1041 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1886gitlab # [ 413.033960] gitaly[1041]: time="2026-09-04T07:46:27.604Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP47FG5SKDXP1R7VQ35H9Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:27.577" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 413.050553] gitlab-workhorse[862]: time="2026-09-04T07:46:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671888gitlab # [ 413.052890] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1671889gitlab # [ 413.055026] gitaly[1041]: time="2026-09-04T07:46:27.607Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP47FG5SKDXP1R7VQ35H9Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:27.577" grpc.time_ms=28.338 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1890gitlab # [ 413.352108] gitaly[1041]: time="2026-09-04T07:46:27.937Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=4 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP47S1S7RRGD0N4GJTMYD1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:27.903" grpc.time_ms=32.756 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1891gitlab # [ 413.373742] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1941892gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1893gitlab # [ 413.563592] gitaly[1041]: time="2026-09-04T07:46:28.148Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP47Z91JXBGQ0Y8MEASYXN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:28.106" pid=1041 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1894gitlab # [ 413.584666] gitaly[1041]: time="2026-09-04T07:46:28.149Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=3 command.system_time_ms=21 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP47Z91JXBGQ0Y8MEASYXN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:28.106" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1895gitlab # [ 413.605849] gitlab-workhorse[862]: time="2026-09-04T07:46:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161896gitlab # [ 413.608363] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 2081897gitlab # [ 413.610727] gitaly[1041]: time="2026-09-04T07:46:28.155Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=3 command.system_time_ms=21 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP47Z91JXBGQ0Y8MEASYXN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:28.106" grpc.time_ms=44.452 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc1898gitlab # [ 413.628173] nixbot[3929]: INFO: ::ffff:127.0.0.1:54852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.13 seconds)1900gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1901gitlab # [ 414.715189] nixbot[3929]: INFO: ::ffff:127.0.0.1:54868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.09 seconds)1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1904gitlab # [ 415.794221] nixbot[3929]: INFO: ::ffff:127.0.0.1:54876 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1905gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.08 seconds)1906gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1907gitlab # [ 416.884544] nixbot[3929]: INFO: ::ffff:127.0.0.1:54878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1908gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.09 seconds)1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1910gitlab # [ 417.980535] nixbot[3929]: INFO: ::ffff:127.0.0.1:54892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.10 seconds)1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1913gitlab # [ 419.078904] nixbot[3929]: INFO: ::ffff:127.0.0.1:54900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.10 seconds)1915gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1916gitlab # [ 420.178135] nixbot[3929]: INFO: ::ffff:127.0.0.1:54910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1917gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.10 seconds)1918gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1919gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1920gitlab # [ 421.237895] nixbot[3929]: INFO: ::ffff:127.0.0.1:58146 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1922gitlab # [ 422.295478] nixbot[3929]: INFO: ::ffff:127.0.0.1:58158 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1924gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1925gitlab # [ 423.352283] nixbot[3929]: INFO: ::ffff:127.0.0.1:58172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1927gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1928gitlab # [ 424.411481] nixbot[3929]: INFO: ::ffff:127.0.0.1:58184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1929gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1930gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1931gitlab # [ 425.470210] nixbot[3929]: INFO: ::ffff:127.0.0.1:58190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1932gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1933gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1934gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1935gitlab # [ 426.528290] nixbot[3929]: INFO: ::ffff:127.0.0.1:58198 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1936gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1937gitlab # [ 427.584754] nixbot[3929]: INFO: ::ffff:127.0.0.1:58214 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1939gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1940gitlab # [ 428.643366] nixbot[3929]: INFO: ::ffff:127.0.0.1:58224 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1941gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1942gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1943gitlab # [ 429.701886] nixbot[3929]: INFO: ::ffff:127.0.0.1:58238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1944gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1945gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1946gitlab # [ 430.758043] nixbot[3929]: INFO: ::ffff:127.0.0.1:58244 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1947gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1948gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1949gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1950gitlab # [ 431.815931] nixbot[3929]: INFO: ::ffff:127.0.0.1:41724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1951gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1952gitlab # [ 432.872819] nixbot[3929]: INFO: ::ffff:127.0.0.1:41726 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1955gitlab # [ 433.929803] nixbot[3929]: INFO: ::ffff:127.0.0.1:41740 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1958gitlab # [ 434.986218] nixbot[3929]: INFO: ::ffff:127.0.0.1:41742 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1962gitlab # [ 436.043255] nixbot[3929]: INFO: ::ffff:127.0.0.1:41756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1963gitlab # [ 436.380374] sidekiq-cluster[3909]: 2026-09-04T07:46:50.964Z pid=3909 tid=yct INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3909, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434024448}1964gitlab # [ 436.683274] sidekiq-cluster[3909]: W, [2026-09-04T07:46:51.268578 #3909] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1965gitlab # [ 436.750749] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:46:51.336Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1967gitlab # [ 437.100337] nixbot[3929]: INFO: ::ffff:127.0.0.1:41766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1970gitlab # [ 438.156159] nixbot[3929]: INFO: ::ffff:127.0.0.1:41768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1973gitlab # [ 439.214230] nixbot[3929]: INFO: ::ffff:127.0.0.1:41774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1974gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1976gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1977gitlab # [ 440.272194] nixbot[3929]: INFO: ::ffff:127.0.0.1:41786 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1978gitlab # [ 440.435073] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:46:55.019Z","message":"GitLab reliable fetch activated!"}1979gitlab # [ 440.440311] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:46:55.019Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1981gitlab # [ 441.331892] nixbot[3929]: INFO: ::ffff:127.0.0.1:52380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1984gitlab # [ 442.392446] nixbot[3929]: INFO: ::ffff:127.0.0.1:52394 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1987gitlab # [ 443.450745] nixbot[3929]: INFO: ::ffff:127.0.0.1:52410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1990gitlab # [ 444.509703] nixbot[3929]: INFO: ::ffff:127.0.0.1:52420 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1993gitlab # [ 445.567947] nixbot[3929]: INFO: ::ffff:127.0.0.1:52422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)1997gitlab # [ 446.626111] nixbot[3929]: INFO: ::ffff:127.0.0.1:52434 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK1998gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'1999gitlab # [ 447.684665] nixbot[3929]: INFO: ::ffff:127.0.0.1:52448 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2001gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2002gitlab # [ 448.742988] nixbot[3929]: INFO: ::ffff:127.0.0.1:52454 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2004gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2005gitlab # [ 449.800116] nixbot[3929]: INFO: ::ffff:127.0.0.1:52468 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2006gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2007gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2008gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2009gitlab # [ 450.860157] nixbot[3929]: INFO: ::ffff:127.0.0.1:36754 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2011gitlab # [ 451.916377] nixbot[3929]: INFO: ::ffff:127.0.0.1:36770 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2015gitlab # [ 452.975416] nixbot[3929]: INFO: ::ffff:127.0.0.1:36772 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2017gitlab # [ 454.033062] nixbot[3929]: INFO: ::ffff:127.0.0.1:36780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2020gitlab # [ 455.091312] nixbot[3929]: INFO: ::ffff:127.0.0.1:36786 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2023gitlab # [ 456.148237] nixbot[3929]: INFO: ::ffff:127.0.0.1:36798 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.05 seconds)2027gitlab # [ 457.205799] nixbot[3929]: INFO: ::ffff:127.0.0.1:36806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2028gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2029gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.05 seconds)2030gitlab # [ 458.261344] nixbot[3929]: INFO: ::ffff:127.0.0.1:36812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2031gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2032gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2033gitlab # [ 459.319088] nixbot[3929]: INFO: ::ffff:127.0.0.1:36814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2034gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2035gitlab # [ 460.376294] nixbot[3929]: INFO: ::ffff:127.0.0.1:36820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2036gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2037gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2038gitlab # [ 461.439145] nixbot[3929]: INFO: ::ffff:127.0.0.1:35668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2039gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2041gitlab # [ 462.497655] nixbot[3929]: INFO: ::ffff:127.0.0.1:35670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2043gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2044gitlab # [ 463.556454] nixbot[3929]: INFO: ::ffff:127.0.0.1:35682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2045gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2046gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2047gitlab # [ 464.614657] nixbot[3929]: INFO: ::ffff:127.0.0.1:35688 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2048gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2049gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2050gitlab # [ 465.673045] nixbot[3929]: INFO: ::ffff:127.0.0.1:35690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2051gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2052gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2054gitlab # [ 466.732576] nixbot[3929]: INFO: ::ffff:127.0.0.1:35704 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2055gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2056gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2057gitlab # [ 467.788128] nixbot[3929]: INFO: ::ffff:127.0.0.1:35712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2058gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2059gitlab # [ 468.843908] nixbot[3929]: INFO: ::ffff:127.0.0.1:35724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2060gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2061gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2062gitlab # [ 469.903169] nixbot[3929]: INFO: ::ffff:127.0.0.1:35738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2063gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2064gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2065gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2066gitlab # [ 470.961544] nixbot[3929]: INFO: ::ffff:127.0.0.1:56506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2067gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2068gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.05 seconds)2069gitlab # [ 472.015915] nixbot[3929]: INFO: ::ffff:127.0.0.1:56508 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2070gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2071gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2072gitlab # [ 473.071944] nixbot[3929]: INFO: ::ffff:127.0.0.1:56512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2073gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2074gitlab # [ 474.130911] nixbot[3929]: INFO: ::ffff:127.0.0.1:56522 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2075gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2076gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2077gitlab # [ 475.192268] nixbot[3929]: INFO: ::ffff:127.0.0.1:56524 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2078gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2079gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2080gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2081gitlab # [ 476.252675] nixbot[3929]: INFO: ::ffff:127.0.0.1:56528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2082gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2083gitlab # [ 477.308832] nixbot[3929]: INFO: ::ffff:127.0.0.1:56542 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2084gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2085gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2086gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2087gitlab # [ 478.371812] nixbot[3929]: INFO: ::ffff:127.0.0.1:56556 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2088gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2089gitlab # [ 479.427161] nixbot[3929]: INFO: ::ffff:127.0.0.1:56558 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2090gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2091gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2092gitlab # [ 480.476347] postgres[4527]: [4527] ERROR: relation "table_without_models" does not exist2093gitlab # [ 480.476736] postgres[4527]: [4527] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2094gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2095gitlab # [ 480.487323] nixbot[3929]: INFO: ::ffff:127.0.0.1:56574 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2096gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2097gitlab # [ 481.548134] nixbot[3929]: INFO: ::ffff:127.0.0.1:36458 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2098gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2099gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2100gitlab # [ 482.603142] nixbot[3929]: INFO: ::ffff:127.0.0.1:36462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2101gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.05 seconds)2102gitlab # [ 482.936120] sidekiq-cluster[3909]: InitializerConnections Query: SET client_min_messages TO 'warning'2103gitlab # [ 482.940088] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2104gitlab # [ 482.945121] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2105gitlab # [ 482.948941] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2106gitlab # [ 482.953010] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2107gitlab # [ 482.956695] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2108gitlab # [ 482.960317] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2109gitlab # [ 482.964898] sidekiq-cluster[3909]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2110gitlab # [ 482.969775] sidekiq-cluster[3909]: InitializerConnections Query: SET standard_conforming_strings = on2111gitlab # [ 482.973440] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2112gitlab # [ 482.977736] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2113gitlab # [ 482.981334] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2114gitlab # [ 482.984882] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2115gitlab # [ 482.987853] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2116gitlab # [ 482.990755] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2117gitlab # [ 482.994391] sidekiq-cluster[3909]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2118gitlab # [ 482.997993] sidekiq-cluster[3909]: InitializerConnections Query: SET intervalstyle = iso_86012119gitlab # [ 483.000375] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2120gitlab # [ 483.003228] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2121gitlab # [ 483.005695] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2122gitlab # [ 483.008191] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2123gitlab # [ 483.010293] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2124gitlab # [ 483.012526] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2125gitlab # [ 483.015079] sidekiq-cluster[3909]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2126gitlab # [ 483.017778] sidekiq-cluster[3909]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname2127gitlab # [ 483.020660] sidekiq-cluster[3909]: FROM pg_type as t2128gitlab # [ 483.021715] sidekiq-cluster[3909]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')2129gitlab # [ 483.024376] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2130gitlab # [ 483.026447] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2131gitlab # [ 483.028245] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2132gitlab # [ 483.030094] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2133gitlab # [ 483.031736] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2134gitlab # [ 483.033420] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2135gitlab # [ 483.035427] sidekiq-cluster[3909]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2136gitlab # [ 483.037579] sidekiq-cluster[3909]: InitializerConnections Query: SET SESSION timezone TO 'UTC'2137gitlab # [ 483.039026] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2138gitlab # [ 483.040866] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2139gitlab # [ 483.042378] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2140gitlab # [ 483.044028] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2141gitlab # [ 483.045482] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2142gitlab # [ 483.046896] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2143gitlab # [ 483.048712] sidekiq-cluster[3909]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2144gitlab # [ 483.052433] sidekiq-cluster[3909]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware'2145gitlab # [ 483.056561] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'2146gitlab # [ 483.058455] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'2147gitlab # [ 483.060134] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'2148gitlab # [ 483.061904] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'2149gitlab # [ 483.063491] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'2150gitlab # [ 483.065179] sidekiq-cluster[3909]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'2151gitlab # [ 483.067206] sidekiq-cluster[3909]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers2152gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2153gitlab # [ 483.666271] nixbot[3929]: INFO: ::ffff:127.0.0.1:36472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2154gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2155gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2156gitlab # [ 484.725223] nixbot[3929]: INFO: ::ffff:127.0.0.1:36482 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2157gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2158gitlab # [ 485.593314] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:40.174Z","message":"Booted Rails 7.2.3.1 application in production environment"}2159gitlab # [ 485.605855] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:40.191Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2160gitlab # [ 485.612165] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:40.191Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2161gitlab # [ 485.617491] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:40.191Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2162gitlab # [ 485.623595] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:40.193Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2163gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2164gitlab # [ 485.784173] nixbot[3929]: INFO: ::ffff:127.0.0.1:36496 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2165gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2166gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2167gitlab # [ 486.883293] nixbot[3929]: INFO: ::ffff:127.0.0.1:36512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2168gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.10 seconds)2169gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2170gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2171gitlab # [ 487.942468] nixbot[3929]: INFO: ::ffff:127.0.0.1:36526 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2172gitlab # [ 488.292222] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:42.875Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"df39cfcaaa2fd7aba1ccedce","created_at":"2026-09-04T07:46:00.903Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:00.969Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-df39cfcaaa2fd7aba1ccedce: start","job_status":"start","queue_duration_s":101.905705,"scheduling_latency_s":101.905899}2173gitlab # [ 488.681603] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:43.265Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"df39cfcaaa2fd7aba1ccedce","created_at":"2026-09-04T07:46:00.903Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:00.969Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-df39cfcaaa2fd7aba1ccedce: done: 0.391112 sec","job_status":"done","queue_duration_s":101.905705,"scheduling_latency_s":101.905899,"redis_calls":23,"redis_duration_s":0.010444,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005091,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003321,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.227531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.23289024,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.391112,"completed_at":"2026-09-04T07:47:43.265Z","load_balancing_strategy":"primary","db_duration_s":0.119889,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2174gitlab # [ 488.779945] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:43.270Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cf2d8d5ba4d0e8c89ccd5d87","created_at":"2026-09-04T07:46:00.990Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:01.001Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cf2d8d5ba4d0e8c89ccd5d87: start","job_status":"start","queue_duration_s":102.268965,"scheduling_latency_s":102.269013}2175gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2176gitlab # [ 489.041498] nixbot[3929]: INFO: ::ffff:127.0.0.1:36540 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2177gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.10 seconds)2178gitlab # [ 489.048502] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:43.629Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cf2d8d5ba4d0e8c89ccd5d87","created_at":"2026-09-04T07:46:00.990Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:01.001Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cf2d8d5ba4d0e8c89ccd5d87: done: 0.359371 sec","job_status":"done","queue_duration_s":102.268965,"scheduling_latency_s":102.269013,"redis_calls":14,"redis_duration_s":0.008784,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00102,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005408,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002356,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.280609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.27774386,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.359371,"completed_at":"2026-09-04T07:47:43.629Z","load_balancing_strategy":"primary","db_duration_s":0.053164,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2179gitlab # [ 489.133249] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:43.638Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"11dceb30fbbad624251b39a1","created_at":"2026-09-04T07:46:02.017Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:02.029Z","job_size_bytes":5,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-11dceb30fbbad624251b39a1: start","job_status":"start","queue_duration_s":101.608277,"scheduling_latency_s":101.608339}2180gitlab # [ 489.478354] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:44.060Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"11dceb30fbbad624251b39a1","created_at":"2026-09-04T07:46:02.017Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:02.029Z","job_size_bytes":5,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-11dceb30fbbad624251b39a1: done: 0.422949 sec","job_status":"done","queue_duration_s":101.608277,"scheduling_latency_s":101.608339,"redis_calls":12,"redis_duration_s":0.006770999999999999,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00225,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003573,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.328489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069708,"duration_s":0.422949,"completed_at":"2026-09-04T07:47:44.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.067576,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2181gitlab # [ 489.577073] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:44.064Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"46c79034c1977d5a5eb10c13","created_at":"2026-09-04T07:46:02.078Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:02.088Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-46c79034c1977d5a5eb10c13: start","job_status":"start","queue_duration_s":101.975915,"scheduling_latency_s":101.975968}2182gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2183gitlab # [ 490.132414] nixbot[3929]: INFO: ::ffff:127.0.0.1:36546 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2184gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.09 seconds)2185gitlab # [ 490.304276] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:44.888Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"46c79034c1977d5a5eb10c13","created_at":"2026-09-04T07:46:02.078Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:02.088Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-46c79034c1977d5a5eb10c13: done: 0.823936 sec","job_status":"done","queue_duration_s":101.975915,"scheduling_latency_s":101.975968,"redis_calls":11,"redis_duration_s":0.007096999999999999,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002234,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.09,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.719,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.719,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.087,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.586576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00165644,"duration_s":0.823936,"completed_at":"2026-09-04T07:47:44.888Z","load_balancing_strategy":"primary","db_duration_s":0.249225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186gitlab # [ 490.401650] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:44.893Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"c719e16c23be8b641228af5c","created_at":"2026-09-04T07:46:02.092Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:02.101Z","job_size_bytes":89,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-c719e16c23be8b641228af5c: start","job_status":"start","queue_duration_s":102.791864,"scheduling_latency_s":102.79192}2187gitlab # [ 490.424285] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:45.008Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"c719e16c23be8b641228af5c","created_at":"2026-09-04T07:46:02.092Z","trace_propagation_headers":{"sentry-trace":"bcb99156ad274a2d961a7c16edfad559-e527c0ebf89a4b6c","baggage":"sentry-trace_id=bcb99156ad274a2d961a7c16edfad559,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3BPTYEH336GWQ2M0Q3WJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:02.101Z","job_size_bytes":89,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-c719e16c23be8b641228af5c: done: 0.115138 sec","job_status":"done","queue_duration_s":102.791864,"scheduling_latency_s":102.79192,"redis_calls":11,"redis_duration_s":0.005894,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001579,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00106436,"duration_s":0.115138,"completed_at":"2026-09-04T07:47:45.008Z","load_balancing_strategy":"primary","db_duration_s":0.017688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2188gitlab # [ 490.476230] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:45.012Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9e6b81bbfdde54f61b8c2f5f","created_at":"2026-09-04T07:46:04.924Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-8c76f2675204484c","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.966Z","job_size_bytes":185,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9e6b81bbfdde54f61b8c2f5f: start","job_status":"start","queue_duration_s":100.046084,"scheduling_latency_s":100.046153}2189gitlab # [ 490.495555] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:45.072Z","message":"changes: \"0000000000000000000000000000000000000000 1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 refs/heads/master\\n\""}2190gitlab # [ 490.596411] gitaly[1041]: time="2026-09-04T07:47:45.180Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:55.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:45.153" grpc.time_ms=26.342 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191gitlab # [ 490.637371] gitaly[1041]: time="2026-09-04T07:47:45.222Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:47:55.044" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:45.195" grpc.time_ms=26.744 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab # [ 490.789890] gitaly[1041]: time="2026-09-04T07:47:45.375Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=5 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:47:55.192" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:45.343" grpc.time_ms=31.035 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 490.914531] gitaly[1041]: time="2026-09-04T07:47:45.499Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3942 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:45.498" grpc.time_ms=1.462 pid=1041 span.kind=server system=grpc2194gitlab # [ 491.012264] gitaly[1041]: time="2026-09-04T07:47:45.597Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3944 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:45.595" grpc.time_ms=2.044 pid=1041 span.kind=server system=grpc2195gitlab # [ 491.042551] gitaly[1041]: time="2026-09-04T07:47:45.617Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M diskcache=c35b7b5c-c430-42a5-9c1f-fe5ce34cc1f2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:47:55.250" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:45.402" pid=1041 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2196gitlab # [ 491.067674] gitaly[1041]: time="2026-09-04T07:47:45.618Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=229 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5132 command.oublock=8 command.real_time_ms=205 command.spawn_token_fork_ms=1 command.system_time_ms=129 command.user_time_ms=100 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:47:55.250" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:45.402" grpc.time_ms=215.983 pid=1041 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2197gitlab # [ 491.095370] gitaly[1041]: time="2026-09-04T07:47:45.680Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:55.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:45.679" grpc.time_ms=0.393 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2199gitlab # [ 491.161407] gitaly[1041]: time="2026-09-04T07:47:45.746Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=33 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=861 command.oublock=0 command.real_time_ms=37 command.spawn_token_fork_ms=5 command.system_time_ms=29 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:47:55.029" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:45.700" grpc.time_ms=45.466 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2200gitlab # [ 491.225882] nixbot[3929]: INFO: ::ffff:127.0.0.1:32896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2201gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.09 seconds)2202gitlab # [ 491.523527] gitaly[1041]: time="2026-09-04T07:47:46.108Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-04T07:48:16.086" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:46.087" grpc.time_ms=20.748 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2203gitlab # [ 491.638735] gitaly[1041]: time="2026-09-04T07:47:46.222Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:47:56.069" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:46.220" grpc.time_ms=1.4 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 491.670763] gitaly[1041]: time="2026-09-04T07:47:46.250Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:47:56.080" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:47:46.231" grpc.time_ms=17.849 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2205gitlab # [ 491.754244] gitaly[1041]: time="2026-09-04T07:47:46.339Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:56.158" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:46.309" grpc.time_ms=29.587 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab # [ 491.804478] gitaly[1041]: time="2026-09-04T07:47:46.389Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=12 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:56.212" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:46.363" grpc.time_ms=26.156 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab # [ 491.892979] gitaly[1041]: time="2026-09-04T07:47:46.478Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=35 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=38 command.spawn_token_fork_ms=3 command.system_time_ms=35 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:48:16.430" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:46.431" grpc.time_ms=46.78 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2208gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2209gitlab # [ 492.315916] nixbot[3929]: INFO: ::ffff:127.0.0.1:32904 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2210gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.09 seconds)2211gitlab # [ 493.160868] gitaly[1041]: time="2026-09-04T07:47:47.744Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:47:57.069" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:47.740" grpc.time_ms=3.766 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2212gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2213gitlab # [ 493.227297] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:47.810Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9e6b81bbfdde54f61b8c2f5f","created_at":"2026-09-04T07:46:04.924Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-8c76f2675204484c","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.966Z","job_size_bytes":185,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9e6b81bbfdde54f61b8c2f5f: done: 2.797763 sec","job_status":"done","queue_duration_s":100.046084,"scheduling_latency_s":100.046153,"gitaly_calls":13,"gitaly_duration_s":0.598916,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.113024,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.013652,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.013275,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.003763,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.011697,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.046053,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.024584,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.171,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.568,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.657,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.171,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.917077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00159106,"exclusive_lock_hold_duration_s":0.06959712,"duration_s":2.797763,"completed_at":"2026-09-04T07:47:47.809Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.289219,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2214gitlab # [ 493.335733] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:47.814Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 0e4246fe7989959ccaa7a0b477e69c5b50b1944a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0e443034bbc2c8ca579f36a9","created_at":"2026-09-04T07:46:12.941Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-d8676d205eb64c90","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:12.944Z","job_size_bytes":185,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0e443034bbc2c8ca579f36a9: start","job_status":"start","queue_duration_s":94.869909,"scheduling_latency_s":94.869939}2215gitlab # [ 493.361416] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:47.839Z","message":"changes: \"1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 0e4246fe7989959ccaa7a0b477e69c5b50b1944a refs/heads/master\\n\""}2216gitlab # [ 493.365719] gitaly[1041]: time="2026-09-04T07:47:47.907Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=4 command.system_time_ms=15 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:57.207" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:47.878" grpc.time_ms=29.382 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.08 seconds)2218gitlab # [ 493.382516] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:47.940Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"f5007185c3d5725d8b99f895","created_at":"2026-09-04T07:47:47.936Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-6272f66ee3bb44be","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"10efc5ff0a9161eeec5b3a61","job_size_bytes":46,"pid":3909,"job_status":"deduplicated","message":"ProjectCacheWorker JID-f5007185c3d5725d8b99f895: deduplicated: until executing","deduplication.type":"until executing"}2219gitlab # [ 493.401019] gitaly[1041]: time="2026-09-04T07:47:47.932Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:47:57.248" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:47.919" grpc.time_ms=12.268 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2220gitlab # [ 493.417344] nixbot[3929]: INFO: ::ffff:127.0.0.1:32914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2221gitlab # [ 493.419595] gitaly[1041]: time="2026-09-04T07:47:47.989Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:47:57.007" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:47.968" grpc.time_ms=20.635 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2222gitlab # [ 493.440387] gitaly[1041]: time="2026-09-04T07:47:48.025Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=14 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-04T07:48:17.095" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:47.996" grpc.time_ms=28.858 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2223gitlab # [ 493.485362] gitaly[1041]: time="2026-09-04T07:47:48.070Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:47:58.008" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:47:48.059" grpc.time_ms=11.329 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2224gitlab # [ 493.548129] gitaly[1041]: time="2026-09-04T07:47:48.133Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=4 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:58.056" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:48.108" grpc.time_ms=24.681 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2225gitlab # [ 494.146142] gitaly[1041]: time="2026-09-04T07:47:48.731Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:47:58.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:48.530" grpc.time_ms=201.002 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2226gitlab # [ 494.187176] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:48.771Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 0e4246fe7989959ccaa7a0b477e69c5b50b1944a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0e443034bbc2c8ca579f36a9","created_at":"2026-09-04T07:46:12.941Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-d8676d205eb64c90","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:12.944Z","job_size_bytes":185,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0e443034bbc2c8ca579f36a9: done: 0.956957 sec","job_status":"done","queue_duration_s":94.869909,"scheduling_latency_s":94.869939,"gitaly_calls":7,"gitaly_duration_s":0.37299,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.065255,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.00692,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.002595,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00958,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.015711,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.030449,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.093,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.093,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.071,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.690188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00129334,"exclusive_lock_hold_duration_s":0.04887202,"duration_s":0.956957,"completed_at":"2026-09-04T07:47:48.771Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.074143,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2227gitlab # [ 494.280147] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:48.774Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e799fea2da4e84e7bfc7a854","created_at":"2026-09-04T07:46:14.624Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-8fe8b49a94cb47c8","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:14.636Z","job_size_bytes":65,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e799fea2da4e84e7bfc7a854: start","job_status":"start","queue_duration_s":94.137648,"scheduling_latency_s":94.137682}2228gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2229gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.05 seconds)2230gitlab # [ 494.381596] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:48.965Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e799fea2da4e84e7bfc7a854","created_at":"2026-09-04T07:46:14.624Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-8fe8b49a94cb47c8","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:14.636Z","job_size_bytes":65,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e799fea2da4e84e7bfc7a854: done: 0.19143 sec","job_status":"done","queue_duration_s":94.137648,"scheduling_latency_s":94.137682,"redis_calls":16,"redis_duration_s":0.007931,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003852,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.11042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009604,"duration_s":0.19143,"completed_at":"2026-09-04T07:47:48.965Z","load_balancing_strategy":"primary","db_duration_s":0.065774,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2231gitlab # [ 494.475922] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:48.970Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"85672d218e5c5962a1d8d545","created_at":"2026-09-04T07:46:14.638Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-8fe8b49a94cb47c8","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:14.646Z","job_size_bytes":65,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-85672d218e5c5962a1d8d545: start","job_status":"start","queue_duration_s":94.32335,"scheduling_latency_s":94.323398}2232gitlab # [ 494.501970] nixbot[3929]: INFO: ::ffff:127.0.0.1:32922 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2233gitlab # [ 494.846538] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:49.429Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"85672d218e5c5962a1d8d545","created_at":"2026-09-04T07:46:14.638Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-8fe8b49a94cb47c8","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:14.646Z","job_size_bytes":65,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-85672d218e5c5962a1d8d545: done: 0.459433 sec","job_status":"done","queue_duration_s":94.32335,"scheduling_latency_s":94.323398,"redis_calls":21,"redis_duration_s":0.011448,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.005002,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002727,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":16,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.105,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.084,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.311414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00183248,"duration_s":0.459433,"completed_at":"2026-09-04T07:47:49.429Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.121364,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 494.946589] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:49.436Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"22466d6fe8522b922021200f","created_at":"2026-09-04T07:46:14.835Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-8fe8b49a94cb47c8","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:14.844Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-22466d6fe8522b922021200f: start","job_status":"start","queue_duration_s":94.591614,"scheduling_latency_s":94.591672}2235gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2236gitlab # [ 495.429470] gitaly[1041]: time="2026-09-04T07:47:50.012Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:50.010" grpc.time_ms=2.034 pid=1041 span.kind=server system=grpc2237gitlab # [ 495.516109] gitaly[1041]: time="2026-09-04T07:47:50.101Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:50.098" grpc.time_ms=1.689 pid=1041 span.kind=server system=grpc2238gitlab # [ 495.537673] nixbot[3929]: INFO: ::ffff:127.0.0.1:32936 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2239gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.09 seconds)2240gitlab # [ 495.597957] gitaly[1041]: time="2026-09-04T07:47:50.183Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:50.181" grpc.time_ms=1.699 pid=1041 span.kind=server system=grpc2241gitlab # [ 495.623948] gitaly[1041]: time="2026-09-04T07:47:50.206Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 diskcache=06c1c81d-d074-484a-a212-26a6d280b677 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:19.008" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:49.910" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2242gitlab # [ 495.644144] gitaly[1041]: time="2026-09-04T07:47:50.207Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=322 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=774144 command.minflt=7562 command.oublock=0 command.real_time_ms=285 command.spawn_token_fork_ms=2 command.system_time_ms=198 command.user_time_ms=124 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:19.008" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:49.910" grpc.time_ms=296.565 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2243gitlab # [ 496.044126] gitaly[1041]: time="2026-09-04T07:47:50.629Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:20.625" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:50.626" grpc.time_ms=2.81 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2244gitlab # [ 496.141306] gitaly[1041]: time="2026-09-04T07:47:50.726Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3SZJX2VVSR8BNAKE2966 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:20.722" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:50.723" grpc.time_ms=2.019 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2245gitlab # [ 496.185607] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:50.767Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"22466d6fe8522b922021200f","created_at":"2026-09-04T07:46:14.835Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-8fe8b49a94cb47c8","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:14.844Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-22466d6fe8522b922021200f: done: 1.33092 sec","job_status":"done","queue_duration_s":94.591614,"scheduling_latency_s":94.591672,"gitaly_calls":3,"gitaly_duration_s":0.319521,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.067898,"redis_read_bytes":457,"redis_write_bytes":27998,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00406,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002761,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.023998,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.010934,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14492,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.013597,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001794,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002103,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004591,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.172,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.073,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.081,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.076,"db_ci_duration_s":0.096,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.786705,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":1.14341586,"duration_s":1.33092,"completed_at":"2026-09-04T07:47:50.767Z","load_balancing_strategy":"primary","db_duration_s":0.202376,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2246gitlab # [ 496.288314] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:50.771Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"10efc5ff0a9161eeec5b3a61","created_at":"2026-09-04T07:47:45.229Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.270Z","job_size_bytes":46,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-10efc5ff0a9161eeec5b3a61: start","job_status":"start","queue_duration_s":5.50097,"scheduling_latency_s":5.501006}2247gitlab # [ 496.314521] gitaly[1041]: time="2026-09-04T07:47:50.899Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-04T13:47:50.876" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:50.878" grpc.time_ms=20.318 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2248gitlab # [ 496.384638] gitaly[1041]: time="2026-09-04T07:47:50.969Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:48:20.039" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:50.940" grpc.time_ms=28.08 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2249gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2250gitlab # [ 496.484772] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:51.068Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"10efc5ff0a9161eeec5b3a61","created_at":"2026-09-04T07:47:45.229Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.270Z","job_size_bytes":46,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-10efc5ff0a9161eeec5b3a61: done: 0.29738 sec","job_status":"done","queue_duration_s":5.50097,"scheduling_latency_s":5.501006,"gitaly_calls":2,"gitaly_duration_s":0.066675,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.017245999999999997,"redis_read_bytes":69,"redis_write_bytes":4883,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002754,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001457,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003215,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.008228,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.187348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066808,"duration_s":0.29738,"completed_at":"2026-09-04T07:47:51.068Z","load_balancing_strategy":"primary","db_duration_s":0.032256,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2251gitlab # [ 496.586473] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:51.073Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0d88a81ccb4c58441e0c3c7b","created_at":"2026-09-04T07:47:45.319Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.331Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0d88a81ccb4c58441e0c3c7b: start","job_status":"start","queue_duration_s":5.74183,"scheduling_latency_s":5.741865}2252gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.08 seconds)2253gitlab # [ 496.612964] gitaly[1041]: time="2026-09-04T07:47:51.196Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M diskcache=47dc292f-b6e1-406d-8112-17cfdc8b1322 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:47:51.127" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:51.129" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2254gitlab # [ 496.626450] gitaly[1041]: time="2026-09-04T07:47:51.196Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=40 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=80 command.spawn_token_fork_ms=9 command.system_time_ms=28 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:47:51.127" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:51.129" grpc.time_ms=67.307 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2255gitlab # [ 496.645728] nixbot[3929]: INFO: ::ffff:127.0.0.1:32946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2256gitlab # [ 496.765566] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:51.349Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0d88a81ccb4c58441e0c3c7b","created_at":"2026-09-04T07:47:45.319Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.331Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0d88a81ccb4c58441e0c3c7b: done: 0.275687 sec","job_status":"done","queue_duration_s":5.74183,"scheduling_latency_s":5.741865,"gitaly_calls":1,"gitaly_duration_s":0.076141,"redis_calls":15,"redis_duration_s":0.008372,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000708,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00377,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001334,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00256,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.043,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.081,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.147665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20836168000000002,"duration_s":0.275687,"completed_at":"2026-09-04T07:47:51.348Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2257gitlab # [ 496.871268] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:51.355Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"f81405f6ed63c263e2051c2f","created_at":"2026-09-04T07:47:45.659Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.669Z","job_size_bytes":23,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f81405f6ed63c263e2051c2f: start","job_status":"start","queue_duration_s":5.686056,"scheduling_latency_s":5.686094}2258gitlab # [ 496.916237] gitaly[1041]: time="2026-09-04T07:47:51.467Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=2 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:48:21.037" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:51.438" grpc.time_ms=28.291 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab # [ 496.941799] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:51.503Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"f81405f6ed63c263e2051c2f","created_at":"2026-09-04T07:47:45.659Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.669Z","job_size_bytes":23,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f81405f6ed63c263e2051c2f: done: 0.148708 sec","job_status":"done","queue_duration_s":5.686056,"scheduling_latency_s":5.686094,"gitaly_calls":1,"gitaly_duration_s":0.034925,"redis_calls":16,"redis_duration_s":0.009914,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000854,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.004496,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001591,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.148708,"completed_at":"2026-09-04T07:47:51.503Z","load_balancing_strategy":"primary","db_duration_s":0.008387,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2260gitlab # [ 496.997111] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:51.509Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d13b549f19a7b14dfbf1c2ba","created_at":"2026-09-04T07:47:47.230Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5db743aad337138dc0c3a44b56f2ff70d14ab2fc5f30e763bc07bef62439c4fb","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:47.247Z","job_size_bytes":467,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d13b549f19a7b14dfbf1c2ba: start","job_status":"start","queue_duration_s":4.262553,"scheduling_latency_s":4.262592}2261gitlab # [ 497.014455] gitaly[1041]: time="2026-09-04T07:47:51.588Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:21.185" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:51.586" grpc.time_ms=1.762 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 497.037994] gitaly[1041]: time="2026-09-04T07:47:51.623Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:48:01.073" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:51.594" grpc.time_ms=28.45 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2263gitlab # [ 497.401209] gitaly[1041]: time="2026-09-04T07:47:51.986Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:21.582" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:51.982" grpc.time_ms=2.828 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2264gitlab # [ 497.440461] gitaly[1041]: time="2026-09-04T07:47:52.004Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=159 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:48:21.592" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:51.992" grpc.time_ms=10.683 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2265gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2266gitlab # [ 497.627938] gitaly[1041]: time="2026-09-04T07:47:52.211Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:02.132" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:52.182" grpc.time_ms=27.707 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2267gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.06 seconds)2268gitlab # [ 497.677796] nixbot[3929]: INFO: ::ffff:127.0.0.1:32958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2269gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2270gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.08 seconds)2271gitlab # [ 498.759102] nixbot[3929]: INFO: ::ffff:127.0.0.1:32966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2272gitlab # [ 498.805227] gitaly[1041]: time="2026-09-04T07:47:53.388Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=33 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=878 command.oublock=0 command.real_time_ms=37 command.spawn_token_fork_ms=4 command.system_time_ms=29 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:48:23.042" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:53.343" grpc.time_ms=44.762 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2273gitlab # [ 498.858827] gitaly[1041]: time="2026-09-04T07:47:53.443Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=5 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3FVK7GJXBNY58SC69Z3M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:48:23.099" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:53.400" grpc.time_ms=42.74 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 498.964753] sidekiq-cluster[3909]: {"severity":"WARN","time":"2026-09-04T07:47:53.547Z","class":"CreatePipelineWorker","correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34","ref":"refs/heads/master"},"retry":0}2275gitlab # [ 498.987005] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:53.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d13b549f19a7b14dfbf1c2ba","created_at":"2026-09-04T07:47:47.230Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5db743aad337138dc0c3a44b56f2ff70d14ab2fc5f30e763bc07bef62439c4fb","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:47.247Z","job_size_bytes":467,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d13b549f19a7b14dfbf1c2ba: done: 2.059649 sec","job_status":"done","queue_duration_s":4.262553,"scheduling_latency_s":4.262592,"gitaly_calls":7,"gitaly_duration_s":0.200241,"redis_calls":51,"redis_duration_s":0.036713,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001997,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.021297,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.006853,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003309,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.086,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.073,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.68531,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007148,"duration_s":2.059649,"completed_at":"2026-09-04T07:47:53.569Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.158633,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2276gitlab # [ 499.068691] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:53.574Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f8bde58f-3ca1-4e67-a33f-d0dc04b7f54a\"}"],"class":"WebHookWorker","jid":"c7efe9441ea1a070d8d2f652","created_at":"2026-09-04T07:47:47.670Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bcc59ea0b0a5c1dff48e2353f5c6a5d28d41cdc83680923a4ba4f26d744c71e4","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:47.681Z","job_size_bytes":1751,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c7efe9441ea1a070d8d2f652: start","job_status":"start","queue_duration_s":5.892163,"scheduling_latency_s":5.892196}2277gitlab # [ 499.307197] nixbot[3929]: INFO: ::ffff:127.0.0.1:32970 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2278gitlab # [ 499.389367] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:53.972Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f8bde58f-3ca1-4e67-a33f-d0dc04b7f54a\"}"],"class":"WebHookWorker","jid":"c7efe9441ea1a070d8d2f652","created_at":"2026-09-04T07:47:47.670Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-c788368048304e5f","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bcc59ea0b0a5c1dff48e2353f5c6a5d28d41cdc83680923a4ba4f26d744c71e4","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:47.681Z","job_size_bytes":1751,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c7efe9441ea1a070d8d2f652: done: 0.398465 sec","job_status":"done","queue_duration_s":5.892163,"scheduling_latency_s":5.892196,"redis_calls":19,"redis_duration_s":0.009832,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002265,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000836,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004748,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.16800777999998218,"cpu_s":0.193188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00170802,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.398465,"completed_at":"2026-09-04T07:47:53.972Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010187,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2279gitlab # [ 499.489191] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:53.982Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"86469849011440f030a3b5bd","created_at":"2026-09-04T07:47:47.955Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-6272f66ee3bb44be","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"0d88a81ccb4c58441e0c3c7b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:47.960Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-86469849011440f030a3b5bd: start","job_status":"start","queue_duration_s":6.022031,"scheduling_latency_s":6.022236}2280gitlab # [ 499.511222] gitaly[1041]: time="2026-09-04T07:47:54.069Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C diskcache=9f064b31-9253-4fee-b04b-5abd29bfb807 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:47:54.050" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:54.051" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2281gitlab # [ 499.524259] gitaly[1041]: time="2026-09-04T07:47:54.070Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:47:54.050" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:54.051" grpc.time_ms=18.125 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2282gitlab # [ 499.543336] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:54.111Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"86469849011440f030a3b5bd","created_at":"2026-09-04T07:47:47.955Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-6272f66ee3bb44be","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"0d88a81ccb4c58441e0c3c7b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:47.960Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-86469849011440f030a3b5bd: done: 0.129513 sec","job_status":"done","queue_duration_s":6.022031,"scheduling_latency_s":6.022236,"gitaly_calls":1,"gitaly_duration_s":0.024168,"redis_calls":12,"redis_duration_s":0.00774,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001394,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06526548,"duration_s":0.129513,"completed_at":"2026-09-04T07:47:54.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2283gitlab # [ 499.593606] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:54.116Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"163a1d0aa8b0c434b1019848","created_at":"2026-09-04T07:47:48.376Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-6272f66ee3bb44be","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3c440e4eb5a7306af501aa3546bfded7053985f28128d94d999f89f327d546bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:48.388Z","job_size_bytes":467,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-163a1d0aa8b0c434b1019848: start","job_status":"start","queue_duration_s":5.7279,"scheduling_latency_s":5.727929}2284gitlab # [ 499.611154] gitaly[1041]: time="2026-09-04T07:47:54.190Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:24.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:54.186" grpc.time_ms=3.367 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2285gitlab # [ 499.642153] gitaly[1041]: time="2026-09-04T07:47:54.227Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=4 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:48:04.011" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:54.202" grpc.time_ms=24.687 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2286gitlab # [ 499.711063] gitaly[1041]: time="2026-09-04T07:47:54.296Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6VZGXS90Z2G68R27P83P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:54.276" grpc.time_ms=19.676 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc2287gitlab # [ 499.734621] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 3282288gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2289gitlab # [ 499.750322] gitaly[1041]: time="2026-09-04T07:47:54.335Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:24.232" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:54.333" grpc.time_ms=2.444 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 499.769724] gitaly[1041]: time="2026-09-04T07:47:54.352Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=177 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:48:24.244" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:54.345" grpc.time_ms=6.893 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2291gitlab # [ 499.827562] nixbot[3929]: INFO: ::ffff:127.0.0.1:32972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2292gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.07 seconds)2293gitlab # [ 499.854343] gitaly[1041]: time="2026-09-04T07:47:54.438Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:04.229" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:54.420" grpc.time_ms=18.18 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2294gitlab # [ 500.041376] gitaly[1041]: time="2026-09-04T07:47:54.626Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6W9V3YPM5DN2YVTVJ8Q4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:54.595" pid=1041 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2295gitlab # [ 500.070918] gitaly[1041]: time="2026-09-04T07:47:54.627Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6W9V3YPM5DN2YVTVJ8Q4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:54.595" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc2296gitlab # [ 500.098165] gitlab-workhorse[862]: time="2026-09-04T07:47:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672297gitlab # [ 500.101298] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 3282298gitlab # [ 500.104235] gitaly[1041]: time="2026-09-04T07:47:54.628Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6W9V3YPM5DN2YVTVJ8Q4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:54.595" grpc.time_ms=31.996 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc2299gitlab # [ 500.126400] nixbot[3929]: {"ts": "2026-09-04T07:47:54.711Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2300gitlab # [ 500.387664] gitaly[1041]: time="2026-09-04T07:47:54.972Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6WR90B8G9M35FGNJRHPP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:24.268" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:54.970" grpc.time_ms=2.02 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2302gitlab # [ 500.892501] nixbot[3929]: INFO: ::ffff:127.0.0.1:50880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2303gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.07 seconds)2304gitlab # [ 501.058084] gitaly[1041]: time="2026-09-04T07:47:55.642Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6WR90B8G9M35FGNJRHPP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:05.222" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:55.613" grpc.time_ms=29.073 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 501.161993] gitaly[1041]: time="2026-09-04T07:47:55.747Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=4 command.system_time_ms=18 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:48:25.607" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:55.708" grpc.time_ms=38.451 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2306gitlab # [ 501.205927] gitaly[1041]: time="2026-09-04T07:47:55.791Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3RJFQGQM5YBXBQ62YQ3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:48:25.659" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:55.759" grpc.time_ms=31.07 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2307gitlab # [ 501.261066] sidekiq-cluster[3909]: {"severity":"WARN","time":"2026-09-04T07:47:55.845Z","class":"CreatePipelineWorker","correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34","after":"0e4246fe7989959ccaa7a0b477e69c5b50b1944a","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"0e4246fe7989959ccaa7a0b477e69c5b50b1944a","ref":"refs/heads/master"},"retry":0}2308gitlab # [ 501.287187] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:55.870Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"163a1d0aa8b0c434b1019848","created_at":"2026-09-04T07:47:48.376Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-6272f66ee3bb44be","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3c440e4eb5a7306af501aa3546bfded7053985f28128d94d999f89f327d546bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:48.388Z","job_size_bytes":467,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-163a1d0aa8b0c434b1019848: done: 1.754181 sec","job_status":"done","queue_duration_s":5.7279,"scheduling_latency_s":5.727929,"gitaly_calls":7,"gitaly_duration_s":0.17178,"redis_calls":33,"redis_duration_s":0.016813,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001435,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005594,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.006722,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003062,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.527967,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.754181,"completed_at":"2026-09-04T07:47:55.870Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050001,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2309gitlab # [ 501.358317] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:55.875Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"f9b63947-f928-4d05-b580-f27d66568033\"}"],"class":"WebHookWorker","jid":"2b8c2055360ff632a598d6ab","created_at":"2026-09-04T07:47:48.454Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-6272f66ee3bb44be","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:649236d8320e418978b17ea5a8b18fd9ec4d7a6527e2e9dd2ee7e510ce95d179","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:48.466Z","job_size_bytes":1749,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2b8c2055360ff632a598d6ab: start","job_status":"start","queue_duration_s":7.408908,"scheduling_latency_s":7.408957}2310gitlab # [ 501.379401] nixbot[3929]: INFO: ::ffff:127.0.0.1:50882 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2311gitlab # [ 501.408130] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:55.990Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"f9b63947-f928-4d05-b580-f27d66568033\"}"],"class":"WebHookWorker","jid":"2b8c2055360ff632a598d6ab","created_at":"2026-09-04T07:47:48.454Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-6272f66ee3bb44be","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:649236d8320e418978b17ea5a8b18fd9ec4d7a6527e2e9dd2ee7e510ce95d179","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:48.466Z","job_size_bytes":1749,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-2b8c2055360ff632a598d6ab: done: 0.114298 sec","job_status":"done","queue_duration_s":7.408908,"scheduling_latency_s":7.408957,"redis_calls":14,"redis_duration_s":0.011819,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.002666,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006474,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002679,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.01998180000003913,"cpu_s":0.0656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.114298,"completed_at":"2026-09-04T07:47:55.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006173,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 501.458609] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:55.994Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"dd9115164c89c8f840f7fca8","created_at":"2026-09-04T07:47:49.866Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:49.880Z","job_size_bytes":23,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-dd9115164c89c8f840f7fca8: start","job_status":"start","queue_duration_s":6.113201,"scheduling_latency_s":6.113248}2313gitlab # [ 501.528118] nixbot[3929]: {"ts": "2026-09-04T07:47:56.111Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 \"HTTP/1.1 201 Created\""}2314gitlab # [ 501.536287] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 13512315gitlab # [ 501.582875] gitaly[1041]: time="2026-09-04T07:47:56.168Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6XZATPK9SAX9P1Z3HYYM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:56.148" grpc.time_ms=19.188 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc2316gitlab # [ 501.610981] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1572317gitlab # [ 501.614836] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.191Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"dd9115164c89c8f840f7fca8","created_at":"2026-09-04T07:47:49.866Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:49.880Z","job_size_bytes":23,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-dd9115164c89c8f840f7fca8: done: 0.197176 sec","job_status":"done","queue_duration_s":6.113201,"scheduling_latency_s":6.113248,"redis_calls":10,"redis_duration_s":0.006842,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003421,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0027,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000721,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.139789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062532,"duration_s":0.197176,"completed_at":"2026-09-04T07:47:56.190Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039144,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2318gitlab # [ 501.670980] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.193Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c45caa51c6068f620f37f863","created_at":"2026-09-04T07:47:50.227Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.247Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c45caa51c6068f620f37f863: start","job_status":"start","queue_duration_s":5.945419,"scheduling_latency_s":5.945444}2319gitlab # [ 501.688076] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.258Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c45caa51c6068f620f37f863","created_at":"2026-09-04T07:47:50.227Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.247Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c45caa51c6068f620f37f863: done: 0.065279 sec","job_status":"done","queue_duration_s":5.945419,"scheduling_latency_s":5.945444,"redis_calls":10,"redis_duration_s":0.002651,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000514,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039396,"duration_s":0.065279,"completed_at":"2026-09-04T07:47:56.258Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00997,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2320gitlab # [ 501.733975] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.262Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4c1b703b8038b9a685cda4f2","created_at":"2026-09-04T07:47:50.285Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.318Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4c1b703b8038b9a685cda4f2: start","job_status":"start","queue_duration_s":5.943163,"scheduling_latency_s":5.94319}2321gitlab # [ 501.750169] gitaly[1041]: time="2026-09-04T07:47:56.241Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6Y2NXF38YD9R86PFPJX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:26.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:56.238" grpc.time_ms=2.07 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2322gitlab # [ 501.763136] gitaly[1041]: time="2026-09-04T07:47:56.293Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6Y4BWZ27S1K0DCRB4GYW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:56.275" pid=1041 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2323gitlab # [ 501.775095] gitlab-workhorse[862]: time="2026-09-04T07:47:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672324gitlab # [ 501.777077] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1242325gitlab # [ 501.778979] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.339Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"4c1b703b8038b9a685cda4f2","created_at":"2026-09-04T07:47:50.285Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.318Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-4c1b703b8038b9a685cda4f2: done: 0.077162 sec","job_status":"done","queue_duration_s":5.943163,"scheduling_latency_s":5.94319,"redis_calls":10,"redis_duration_s":0.003827,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000555,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002328,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00144804,"duration_s":0.077162,"completed_at":"2026-09-04T07:47:56.339Z","load_balancing_strategy":"primary","db_duration_s":0.014299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2326gitlab # [ 501.823185] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.345Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f7d5318fb1d01d02b1b82276","created_at":"2026-09-04T07:47:50.391Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.415Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f7d5318fb1d01d02b1b82276: start","job_status":"start","queue_duration_s":5.929637,"scheduling_latency_s":5.929694}2327gitlab # [ 501.839196] gitaly[1041]: time="2026-09-04T07:47:56.294Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6Y4BWZ27S1K0DCRB4GYW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:56.275" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc2328gitlab # [ 501.853173] gitaly[1041]: time="2026-09-04T07:47:56.296Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6Y4BWZ27S1K0DCRB4GYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:56.275" grpc.time_ms=19.066 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc2329gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2330gitlab # [ 501.867876] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.429Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f7d5318fb1d01d02b1b82276","created_at":"2026-09-04T07:47:50.391Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.415Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f7d5318fb1d01d02b1b82276: done: 0.084706 sec","job_status":"done","queue_duration_s":5.929637,"scheduling_latency_s":5.929694,"redis_calls":13,"redis_duration_s":0.013355,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000821,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003656,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003962,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00131632,"duration_s":0.084706,"completed_at":"2026-09-04T07:47:56.429Z","load_balancing_strategy":"primary","db_duration_s":0.009386,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 501.912613] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.434Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e9f9f52363d0cc4013379e92","created_at":"2026-09-04T07:47:50.420Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.442Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e9f9f52363d0cc4013379e92: start","job_status":"start","queue_duration_s":5.991524,"scheduling_latency_s":5.991553}2332gitlab # [ 501.930096] gitaly[1041]: time="2026-09-04T07:47:56.326Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6Y2NXF38YD9R86PFPJX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:06.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:56.309" grpc.time_ms=15.92 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2333gitlab # [ 501.944176] nixbot[3929]: {"ts": "2026-09-04T07:47:56.478Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 \"HTTP/1.1 201 Created\""}2334gitlab # [ 501.946922] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3552335gitlab # [ 501.949667] gitaly[1041]: time="2026-09-04T07:47:56.535Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=11 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6YBA47DD3QKE2H58QM14 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:56.514" grpc.time_ms=20.052 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc2336gitlab # [ 501.963039] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1412337gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.09 seconds)2338gitlab # [ 501.965257] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.540Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e9f9f52363d0cc4013379e92","created_at":"2026-09-04T07:47:50.420Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.442Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e9f9f52363d0cc4013379e92: done: 0.10579 sec","job_status":"done","queue_duration_s":5.991524,"scheduling_latency_s":5.991553,"redis_calls":10,"redis_duration_s":0.01056,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003205,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003326,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060684,"duration_s":0.10579,"completed_at":"2026-09-04T07:47:56.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab # [ 502.011518] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.543Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"dbc9451ace76631327c7e681","created_at":"2026-09-04T07:47:50.444Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.464Z","job_size_bytes":19,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-dbc9451ace76631327c7e681: start","job_status":"start","queue_duration_s":6.078794,"scheduling_latency_s":6.078829}2340gitlab # [ 502.027986] nixbot[3929]: INFO: ::ffff:127.0.0.1:50894 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2341gitlab # [ 502.029955] gitaly[1041]: time="2026-09-04T07:47:56.604Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YEAK3FW4ED41H95RZ9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:26.395" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:56.596" grpc.time_ms=1.03 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2342gitlab # [ 502.042806] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.615Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"dbc9451ace76631327c7e681","created_at":"2026-09-04T07:47:50.444Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.464Z","job_size_bytes":19,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-dbc9451ace76631327c7e681: done: 0.071853 sec","job_status":"done","queue_duration_s":6.078794,"scheduling_latency_s":6.078829,"redis_calls":11,"redis_duration_s":0.010228,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00401,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003212,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003006,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003889,"duration_s":0.071853,"completed_at":"2026-09-04T07:47:56.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005974,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2343gitlab # [ 502.086642] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.619Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2d4f2efff75d16bc5386d0cb","created_at":"2026-09-04T07:47:50.475Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.490Z","job_size_bytes":66,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2d4f2efff75d16bc5386d0cb: start","job_status":"start","queue_duration_s":6.128128,"scheduling_latency_s":6.128172}2344gitlab # [ 502.104124] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.687Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2d4f2efff75d16bc5386d0cb","created_at":"2026-09-04T07:47:50.475Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.490Z","job_size_bytes":66,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2d4f2efff75d16bc5386d0cb: done: 0.068755 sec","job_status":"done","queue_duration_s":6.128128,"scheduling_latency_s":6.128172,"redis_calls":10,"redis_duration_s":0.005013,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001966,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000672,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006093,"duration_s":0.068755,"completed_at":"2026-09-04T07:47:56.687Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2345gitlab # [ 502.149237] gitlab-workhorse[862]: time="2026-09-04T07:47:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672346gitlab # [ 502.151103] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1352347gitlab # [ 502.153497] gitaly[1041]: time="2026-09-04T07:47:56.673Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YFT0B2RQ0JQJGDT95B2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:56.657" pid=1041 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2348gitlab # [ 502.163797] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.690Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"7c528c2edbf033ab070f16ee","created_at":"2026-09-04T07:47:50.493Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.508Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7c528c2edbf033ab070f16ee: start","job_status":"start","queue_duration_s":6.1824,"scheduling_latency_s":6.182425}2349gitlab # [ 502.180327] gitaly[1041]: time="2026-09-04T07:47:56.673Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YFT0B2RQ0JQJGDT95B2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:56.657" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc2350gitlab # [ 502.193641] gitaly[1041]: time="2026-09-04T07:47:56.674Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YFT0B2RQ0JQJGDT95B2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:56.657" grpc.time_ms=16.323 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc2351gitlab # [ 502.210317] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.776Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"7c528c2edbf033ab070f16ee","created_at":"2026-09-04T07:47:50.493Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.508Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7c528c2edbf033ab070f16ee: done: 0.085884 sec","job_status":"done","queue_duration_s":6.1824,"scheduling_latency_s":6.182425,"redis_calls":10,"redis_duration_s":0.008921,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001084,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007284,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062856,"duration_s":0.085884,"completed_at":"2026-09-04T07:47:56.776Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2352gitlab # [ 502.261096] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.782Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"0190965f143f61eaf956e9ce","created_at":"2026-09-04T07:47:50.528Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.543Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0190965f143f61eaf956e9ce: start","job_status":"start","queue_duration_s":6.238362,"scheduling_latency_s":6.238387}2353gitlab # [ 502.277941] nixbot[3929]: {"ts": "2026-09-04T07:47:56.794Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 \"HTTP/1.1 201 Created\""}2354gitlab # [ 502.281261] gitaly[1041]: time="2026-09-04T07:47:56.677Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6YEAK3FW4ED41H95RZ9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:06.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:56.660" grpc.time_ms=16.787 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 502.294748] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1eaaf3383cd0a2ad767238a82e5ee4d2d557bb34 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3022356gitlab # [ 502.297347] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.847Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"0190965f143f61eaf956e9ce","created_at":"2026-09-04T07:47:50.528Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.543Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0190965f143f61eaf956e9ce: done: 0.064876 sec","job_status":"done","queue_duration_s":6.238362,"scheduling_latency_s":6.238387,"redis_calls":10,"redis_duration_s":0.0030729999999999998,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000792,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037456,"duration_s":0.064876,"completed_at":"2026-09-04T07:47:56.847Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2357gitlab # [ 502.340840] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.855Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fca910ed57459e77ee56a1a8","created_at":"2026-09-04T07:47:50.545Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.556Z","job_size_bytes":6,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fca910ed57459e77ee56a1a8: start","job_status":"start","queue_duration_s":6.297947,"scheduling_latency_s":6.297987}2358gitlab # [ 502.356461] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fca910ed57459e77ee56a1a8","created_at":"2026-09-04T07:47:50.545Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.556Z","job_size_bytes":6,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fca910ed57459e77ee56a1a8: done: 0.056848 sec","job_status":"done","queue_duration_s":6.297947,"scheduling_latency_s":6.297987,"redis_calls":10,"redis_duration_s":0.006468,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00062,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062416,"duration_s":0.056848,"completed_at":"2026-09-04T07:47:56.911Z","load_balancing_strategy":"primary","db_duration_s":0.003383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2359gitlab # [ 502.401020] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:56.914Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0e7602e914109c14bfde152a","created_at":"2026-09-04T07:47:50.558Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.570Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0e7602e914109c14bfde152a: start","job_status":"start","queue_duration_s":6.34432,"scheduling_latency_s":6.344341}2360gitlab # [ 502.415990] gitaly[1041]: time="2026-09-04T07:47:56.888Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:26.586" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:56.886" grpc.time_ms=0.95 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2361gitlab # [ 502.428602] gitaly[1041]: time="2026-09-04T07:47:56.918Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:48:26.605" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:56.906" grpc.time_ms=12.088 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2362gitlab # [ 502.442432] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.007Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0e7602e914109c14bfde152a","created_at":"2026-09-04T07:47:50.558Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.570Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0e7602e914109c14bfde152a: done: 0.092987 sec","job_status":"done","queue_duration_s":6.34432,"scheduling_latency_s":6.344341,"redis_calls":10,"redis_duration_s":0.005585,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001181,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003563,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000841,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00135874,"duration_s":0.092987,"completed_at":"2026-09-04T07:47:57.007Z","load_balancing_strategy":"primary","db_duration_s":0.013163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2363gitlab # [ 502.484885] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.011Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"af8b3a50c8693a0497943274","created_at":"2026-09-04T07:47:50.586Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.598Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-af8b3a50c8693a0497943274: start","job_status":"start","queue_duration_s":6.413228,"scheduling_latency_s":6.413256}2364gitlab # [ 502.500783] gitaly[1041]: time="2026-09-04T07:47:56.945Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:06.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:56.933" grpc.time_ms=11.485 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2365gitlab # [ 502.514526] gitaly[1041]: time="2026-09-04T07:47:56.980Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:48:06.049" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:56.980" grpc.time_ms=0.483 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2366gitlab # [ 502.525356] gitaly[1041]: time="2026-09-04T07:47:56.996Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:48:06.056" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:56.987" grpc.time_ms=8.906 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2367gitlab # [ 502.538568] gitaly[1041]: time="2026-09-04T07:47:57.050Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4159 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:57.048" grpc.time_ms=2.405 pid=1041 span.kind=server system=grpc2368gitlab # [ 502.548551] gitaly[1041]: time="2026-09-04T07:47:57.088Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4161 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:57.087" grpc.time_ms=0.637 pid=1041 span.kind=server system=grpc2369gitlab # [ 502.558061] gitaly[1041]: time="2026-09-04T07:47:57.097Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV diskcache=1d6e3b84-7afa-4d02-8caa-71ad1e814bd2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:48:06.069" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:56.999" pid=1041 ref=refs/keep-around/0e4246fe7989959ccaa7a0b477e69c5b50b1944a remote_ip="2001:db8:1::1" revision=0e4246fe7989959ccaa7a0b477e69c5b50b1944a span.kind=server system=grpc username=root2370gitlab # [ 502.569409] gitaly[1041]: time="2026-09-04T07:47:57.097Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=81 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5192 command.oublock=8 command.real_time_ms=91 command.spawn_token_fork_ms=1 command.system_time_ms=47 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:48:06.069" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:56.999" grpc.time_ms=97.37 pid=1041 ref=refs/keep-around/0e4246fe7989959ccaa7a0b477e69c5b50b1944a remote_ip="2001:db8:1::1" revision=0e4246fe7989959ccaa7a0b477e69c5b50b1944a span.kind=server system=grpc username=root2371gitlab # [ 502.583923] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.147Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"af8b3a50c8693a0497943274","created_at":"2026-09-04T07:47:50.586Z","trace_propagation_headers":{"sentry-trace":"0ee193a35efb4d8990f6a4d0db5da68c-49dda124ee5d4826","baggage":"sentry-trace_id=0ee193a35efb4d8990f6a4d0db5da68c,sentry-release=Unknown"},"correlation_id":"01M1NP3SZJX2VVSR8BNAKE2966","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.598Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-af8b3a50c8693a0497943274: done: 0.135598 sec","job_status":"done","queue_duration_s":6.413228,"scheduling_latency_s":6.413256,"redis_calls":14,"redis_duration_s":0.006897,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004018,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065198,"duration_s":0.135598,"completed_at":"2026-09-04T07:47:57.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023435,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2372gitlab # [ 502.628531] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.150Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b4dba1135146cb76d896917e","created_at":"2026-09-04T07:47:51.005Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-ea364c3c22244099","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:51.026Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b4dba1135146cb76d896917e: start","job_status":"start","queue_duration_s":6.124268,"scheduling_latency_s":6.124342}2373gitlab # [ 502.644671] gitaly[1041]: time="2026-09-04T07:47:57.106Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:27.103" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:57.103" grpc.time_ms=1.929 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2374gitlab # [ 502.668671] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.253Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b4dba1135146cb76d896917e","created_at":"2026-09-04T07:47:51.005Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-ea364c3c22244099","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:51.026Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b4dba1135146cb76d896917e: done: 0.103118 sec","job_status":"done","queue_duration_s":6.124268,"scheduling_latency_s":6.124342,"redis_calls":19,"redis_duration_s":0.008837000000000001,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002905,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.001681,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003105,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.017227,"duration_s":0.103118,"completed_at":"2026-09-04T07:47:57.253Z","load_balancing_strategy":"primary","db_duration_s":0.017848,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 502.713574] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.256Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c7efe9441ea1a070d8d2f652"],"class":"WebHooks::LogExecutionWorker","jid":"423662a0bd4a51df5858131f","created_at":"2026-09-04T07:47:53.905Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-bdc3453c4e1140ea","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d912531b0c78e94453586dc5e346a99068cc75fd1504906b3f59a9e7888378af","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:53.930Z","job_size_bytes":2593,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-423662a0bd4a51df5858131f: start","job_status":"start","queue_duration_s":3.326433,"scheduling_latency_s":3.326488}2376gitlab # [ 502.730915] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5692377gitlab # [ 502.733559] nixbot[3929]: {"ts": "2026-09-04T07:47:57.318Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0e4246fe7989959ccaa7a0b477e69c5b50b1944a \"HTTP/1.1 201 Created\""}2378gitlab # [ 502.760688] nixbot[3929]: {"ts": "2026-09-04T07:47:57.345Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-0e4246fe7989-5"}2379gitlab # [ 502.789926] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.373Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c7efe9441ea1a070d8d2f652"],"class":"WebHooks::LogExecutionWorker","jid":"423662a0bd4a51df5858131f","created_at":"2026-09-04T07:47:53.905Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-bdc3453c4e1140ea","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d912531b0c78e94453586dc5e346a99068cc75fd1504906b3f59a9e7888378af","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:53.930Z","job_size_bytes":2593,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-423662a0bd4a51df5858131f: done: 0.117224 sec","job_status":"done","queue_duration_s":3.326433,"scheduling_latency_s":3.326488,"redis_calls":10,"redis_duration_s":0.0071530000000000005,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000834,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005505,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000814,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00094682,"duration_s":0.117224,"completed_at":"2026-09-04T07:47:57.373Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2380gitlab # [ 502.851482] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.378Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2b8c2055360ff632a598d6ab"],"class":"WebHooks::LogExecutionWorker","jid":"51059e15357626318d9d35ea","created_at":"2026-09-04T07:47:55.960Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-8aec1623f2f948c1","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1d1df267b7036a965e9b40bf35507d7e98c936068a07e1f43f799e9d3ae37173","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:55.971Z","job_size_bytes":2591,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-51059e15357626318d9d35ea: start","job_status":"start","queue_duration_s":1.406937,"scheduling_latency_s":1.40698}2381gitlab # [ 502.870793] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.433Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","2b8c2055360ff632a598d6ab"],"class":"WebHooks::LogExecutionWorker","jid":"51059e15357626318d9d35ea","created_at":"2026-09-04T07:47:55.960Z","trace_propagation_headers":{"sentry-trace":"655cc7e545b94c18af8aecdeb0c34623-8aec1623f2f948c1","baggage":"sentry-trace_id=655cc7e545b94c18af8aecdeb0c34623,sentry-release=Unknown"},"correlation_id":"01M1NP3RJFQGQM5YBXBQ62YQ3C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1d1df267b7036a965e9b40bf35507d7e98c936068a07e1f43f799e9d3ae37173","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:55.971Z","job_size_bytes":2591,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-51059e15357626318d9d35ea: done: 0.055662 sec","job_status":"done","queue_duration_s":1.406937,"scheduling_latency_s":1.40698,"redis_calls":7,"redis_duration_s":0.003029,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055662,"completed_at":"2026-09-04T07:47:57.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 502.913913] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:57.436Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c8134a7ab2a25e84ce215d62","created_at":"2026-09-04T07:47:55.988Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-02fb2aeb5756456f","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:56.011Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c8134a7ab2a25e84ce215d62: start","job_status":"start","queue_duration_s":1.424811,"scheduling_latency_s":1.424836}2383gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a'2384gitlab # [ 503.031788] nixbot[3929]: {"ts": "2026-09-04T07:47:57.609Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-0e4246fe7989-5", "argv0": "bwrap"}2385gitlab # [ 503.068946] gitaly[1041]: time="2026-09-04T07:47:57.654Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6WR90B8G9M35FGNJRHPP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:57.652" grpc.time_ms=1.319 pid=1041 span.kind=server system=grpc2386gitlab # [ 503.101678] nixbot[3929]: INFO: ::ffff:127.0.0.1:50900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 200 OK2387gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0e4246fe7989959ccaa7a0b477e69c5b50b1944a', in 0.12 seconds)2388(finished: subtest: push delivers the webhook, in 105.85 seconds)2389subtest: eval and build post commit statuses2390gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses2391gitlab # [ 503.142016] gitaly[1041]: time="2026-09-04T07:47:57.726Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6WR90B8G9M35FGNJRHPP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3901 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:57.721" grpc.time_ms=2.919 pid=1041 span.kind=server system=grpc2392gitlab # [ 503.196594] gitaly[1041]: time="2026-09-04T07:47:57.779Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6WR90B8G9M35FGNJRHPP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3903 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:57.778" grpc.time_ms=0.83 pid=1041 span.kind=server system=grpc2393gitlab # [ 503.209310] gitaly[1041]: time="2026-09-04T07:47:57.794Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6WR90B8G9M35FGNJRHPP diskcache=76a57f6c-c885-4429-9dc1-7bea56c0f799 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:27.477" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:57.577" pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2394gitlab # [ 503.223608] gitaly[1041]: time="2026-09-04T07:47:57.795Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=171 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7067 command.oublock=0 command.real_time_ms=208 command.spawn_token_fork_ms=3 command.system_time_ms=103 command.user_time_ms=68 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6WR90B8G9M35FGNJRHPP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:27.477" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:57.577" grpc.time_ms=217.224 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2395gitlab # [ 503.238256] nix-daemon[4173]: accepted connection from pid 4868, user nixbot2396gitlab # [ 503.270407] gitaly[1041]: time="2026-09-04T07:47:57.855Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6ZMY5WWVEKF8A37J129F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:27.554" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:57.854" grpc.time_ms=0.859 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2397gitlab # [ 503.347170] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2062398gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses, in 0.24 seconds)2399gitlab # [ 503.576753] gitaly[1041]: time="2026-09-04T07:47:58.162Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6WR90B8G9M35FGNJRHPP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:28.058" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:58.159" grpc.time_ms=2.782 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2400gitlab # [ 503.841471] gitaly[1041]: time="2026-09-04T07:47:58.425Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6WR90B8G9M35FGNJRHPP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:28.321" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:58.422" grpc.time_ms=2.623 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2401gitlab # [ 503.982021] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:58.563Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c8134a7ab2a25e84ce215d62","created_at":"2026-09-04T07:47:55.988Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-02fb2aeb5756456f","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:56.011Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3909,"job_status":"rescheduled","message":"PipelineProcessWorker JID-c8134a7ab2a25e84ce215d62: rescheduled"}2402gitlab # [ 504.086826] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:58.669Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"c8134a7ab2a25e84ce215d62","created_at":"2026-09-04T07:47:55.988Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-02fb2aeb5756456f","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:56.011Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c8134a7ab2a25e84ce215d62: done: 1.233219 sec","job_status":"done","queue_duration_s":1.424811,"scheduling_latency_s":1.424836,"gitaly_calls":3,"gitaly_duration_s":0.3255,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.170749,"redis_read_bytes":153,"redis_write_bytes":18010,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000868,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.004071,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.097557,"redis_queues_read_bytes":31,"redis_queues_write_bytes":12309,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.044596,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000504,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.009334,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.012951,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.223,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.015,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.015,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.111,"db_ci_duration_s":0.113,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.457252,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":1.0214941,"duration_s":1.233219,"completed_at":"2026-09-04T07:47:58.669Z","load_balancing_strategy":"primary","db_duration_s":0.223869,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2403gitlab # [ 504.190002] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:58.692Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b7c670856e1c361ceeb68d28","created_at":"2026-09-04T07:47:57.110Z","trace_propagation_headers":{"sentry-trace":"d515a9860acf44059c444aff769f4052-b957da0b4f594e65","baggage":"sentry-trace_id=d515a9860acf44059c444aff769f4052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6YP9WE6FGWTNZ79VT0GV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.119Z","job_size_bytes":65,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b7c670856e1c361ceeb68d28: start","job_status":"start","queue_duration_s":1.573041,"scheduling_latency_s":1.57323}2404gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses2405gitlab # [ 504.554941] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:59.137Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b7c670856e1c361ceeb68d28","created_at":"2026-09-04T07:47:57.110Z","trace_propagation_headers":{"sentry-trace":"d515a9860acf44059c444aff769f4052-b957da0b4f594e65","baggage":"sentry-trace_id=d515a9860acf44059c444aff769f4052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6YP9WE6FGWTNZ79VT0GV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.119Z","job_size_bytes":65,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b7c670856e1c361ceeb68d28: done: 0.445632 sec","job_status":"done","queue_duration_s":1.573041,"scheduling_latency_s":1.57323,"redis_calls":7,"redis_duration_s":0.035514000000000004,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.022751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.012763,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.08,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.157003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.445632,"completed_at":"2026-09-04T07:47:59.137Z","load_balancing_strategy":"primary","db_duration_s":0.097979,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2406gitlab # [ 504.646762] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:59.146Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d4be095468c5c3efcbe58656","created_at":"2026-09-04T07:47:57.121Z","trace_propagation_headers":{"sentry-trace":"d515a9860acf44059c444aff769f4052-b957da0b4f594e65","baggage":"sentry-trace_id=d515a9860acf44059c444aff769f4052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6YP9WE6FGWTNZ79VT0GV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.126Z","job_size_bytes":65,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d4be095468c5c3efcbe58656: start","job_status":"start","queue_duration_s":2.019473,"scheduling_latency_s":2.019533}2407gitlab # [ 504.669624] gitaly[1041]: time="2026-09-04T07:47:59.183Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP70XGVZPE542PR2QX4NVG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:29.180" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:59.181" grpc.time_ms=1.697 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2408gitlab # [ 504.687877] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2462409gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses, in 0.34 seconds)2410gitlab # [ 505.152555] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:59.733Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d4be095468c5c3efcbe58656","created_at":"2026-09-04T07:47:57.121Z","trace_propagation_headers":{"sentry-trace":"d515a9860acf44059c444aff769f4052-b957da0b4f594e65","baggage":"sentry-trace_id=d515a9860acf44059c444aff769f4052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6YP9WE6FGWTNZ79VT0GV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.126Z","job_size_bytes":65,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d4be095468c5c3efcbe58656: done: 0.586596 sec","job_status":"done","queue_duration_s":2.019473,"scheduling_latency_s":2.019533,"redis_calls":10,"redis_duration_s":0.064205,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.049589,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.141,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.104,"db_ci_duration_s":0.037,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.216073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.586596,"completed_at":"2026-09-04T07:47:59.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.151223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2411gitlab # [ 505.226491] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:47:59.757Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"7992b08045b6419823ae7a8e","created_at":"2026-09-04T07:47:57.224Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-426c176adaae4a80","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.236Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-7992b08045b6419823ae7a8e: start","job_status":"start","queue_duration_s":2.520312,"scheduling_latency_s":2.520557}2412gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses2413gitlab # [ 505.832209] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:00.416Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"7992b08045b6419823ae7a8e","created_at":"2026-09-04T07:47:57.224Z","trace_propagation_headers":{"sentry-trace":"2432f309a1f149c7b94d1cf3d9dd5552-426c176adaae4a80","baggage":"sentry-trace_id=2432f309a1f149c7b94d1cf3d9dd5552,sentry-release=Unknown"},"correlation_id":"01M1NP3FVK7GJXBNY58SC69Z3M","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.236Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-7992b08045b6419823ae7a8e: done: 0.659513 sec","job_status":"done","queue_duration_s":2.520312,"scheduling_latency_s":2.520557,"redis_calls":11,"redis_duration_s":0.022703,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.010243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006818,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005642,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.108,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.021,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.108,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.33974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00125416,"duration_s":0.659513,"completed_at":"2026-09-04T07:48:00.415Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.142803,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2414gitlab # [ 505.936345] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:00.421Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f1ab492578311d72e1c92d84","created_at":"2026-09-04T07:47:57.278Z","trace_propagation_headers":{"sentry-trace":"d515a9860acf44059c444aff769f4052-b957da0b4f594e65","baggage":"sentry-trace_id=d515a9860acf44059c444aff769f4052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6YP9WE6FGWTNZ79VT0GV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.286Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f1ab492578311d72e1c92d84: start","job_status":"start","queue_duration_s":3.135033,"scheduling_latency_s":3.135076}2415gitlab # [ 506.007197] gitaly[1041]: time="2026-09-04T07:48:00.589Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP727MYXD0DW9RSF39PHM5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:30.286" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:00.588" grpc.time_ms=1.509 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2416gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses, in 0.42 seconds)2417gitlab # [ 506.114676] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:48:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 3212418gitlab # [ 506.281025] gitaly[1041]: time="2026-09-04T07:48:00.866Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:30.762" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:00.863" grpc.time_ms=3.067 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2419gitlab # [ 506.529702] gitaly[1041]: time="2026-09-04T07:48:01.114Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6YP9WE6FGWTNZ79VT0GV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:31.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:01.111" grpc.time_ms=2.354 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2420gitlab # [ 506.581202] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.162Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f1ab492578311d72e1c92d84","created_at":"2026-09-04T07:47:57.278Z","trace_propagation_headers":{"sentry-trace":"d515a9860acf44059c444aff769f4052-b957da0b4f594e65","baggage":"sentry-trace_id=d515a9860acf44059c444aff769f4052,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6YP9WE6FGWTNZ79VT0GV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.286Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f1ab492578311d72e1c92d84: done: 0.741894 sec","job_status":"done","queue_duration_s":3.135033,"scheduling_latency_s":3.135076,"gitaly_calls":2,"gitaly_duration_s":0.02504,"redis_calls":35,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018709,"redis_read_bytes":81,"redis_write_bytes":5207,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001909,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.004508,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000559,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004541,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000866,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001759,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002658,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.131,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.096,"db_ci_duration_s":0.035,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.575876,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6253931,"duration_s":0.741894,"completed_at":"2026-09-04T07:48:01.162Z","load_balancing_strategy":"primary","db_duration_s":0.137353,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2421gitlab # [ 506.675900] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.170Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"dc3cbea846a6eafbb312e135","created_at":"2026-09-04T07:47:57.563Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.567Z","job_size_bytes":23,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-dc3cbea846a6eafbb312e135: start","job_status":"start","queue_duration_s":3.603361,"scheduling_latency_s":3.603428}2422gitlab # [ 506.728171] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.312Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"dc3cbea846a6eafbb312e135","created_at":"2026-09-04T07:47:57.563Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.567Z","job_size_bytes":23,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-dc3cbea846a6eafbb312e135: done: 0.143451 sec","job_status":"done","queue_duration_s":3.603361,"scheduling_latency_s":3.603428,"redis_calls":7,"redis_duration_s":0.003841,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.143451,"completed_at":"2026-09-04T07:48:01.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039147,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2423gitlab # [ 506.802769] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.316Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"87a5240984b09630f60ffb0d","created_at":"2026-09-04T07:47:57.763Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a73d2938c95ffc78f129956e10bdacd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:47:57.809Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-87a5240984b09630f60ffb0d: start","job_status":"start","queue_duration_s":3.507111,"scheduling_latency_s":3.507215}2424gitlab # [ 506.818619] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.350Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2425gitlab # [ 506.822987] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"87a5240984b09630f60ffb0d","created_at":"2026-09-04T07:47:57.763Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a73d2938c95ffc78f129956e10bdacd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:47:57.809Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-87a5240984b09630f60ffb0d: done: 0.052714 sec","job_status":"done","queue_duration_s":3.507111,"scheduling_latency_s":3.507215,"redis_calls":9,"redis_duration_s":0.004547,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000843,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052714,"completed_at":"2026-09-04T07:48:01.369Z","load_balancing_strategy":"primary","db_duration_s":0.001488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 506.867157] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.372Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"54f26f94de22c8aa9f467431","created_at":"2026-09-04T07:47:57.805Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.830Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-54f26f94de22c8aa9f467431: start","job_status":"start","queue_duration_s":3.541544,"scheduling_latency_s":3.541605}2427gitlab # [ 506.884312] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.436Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"54f26f94de22c8aa9f467431","created_at":"2026-09-04T07:47:57.805Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.830Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-54f26f94de22c8aa9f467431: done: 0.064117 sec","job_status":"done","queue_duration_s":3.541544,"scheduling_latency_s":3.541605,"redis_calls":7,"redis_duration_s":0.004252000000000001,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003409,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000843,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064117,"completed_at":"2026-09-04T07:48:01.436Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2428gitlab # [ 506.928629] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"36ddf216a4df1735c15489cd","created_at":"2026-09-04T07:47:57.823Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83e235752ff2b904d9b7ef2c132b104f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.853Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-36ddf216a4df1735c15489cd: start","job_status":"start","queue_duration_s":3.586196,"scheduling_latency_s":3.586222}2429gitlab # [ 506.998777] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"36ddf216a4df1735c15489cd","created_at":"2026-09-04T07:47:57.823Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83e235752ff2b904d9b7ef2c132b104f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.853Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-36ddf216a4df1735c15489cd: done: 0.143014 sec","job_status":"done","queue_duration_s":3.586196,"scheduling_latency_s":3.586222,"redis_calls":12,"redis_duration_s":0.007962,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000621,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004555,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002786,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05282858,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.143014,"completed_at":"2026-09-04T07:48:01.582Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010458,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2430gitlab # [ 507.042984] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f03710f9623e370b4f964557","created_at":"2026-09-04T07:47:57.865Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0605857e136ac0c0b973eb8ac207663b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.879Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f03710f9623e370b4f964557: start","job_status":"start","queue_duration_s":3.708626,"scheduling_latency_s":3.708756}2431gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses2432gitlab # [ 507.094076] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f03710f9623e370b4f964557","created_at":"2026-09-04T07:47:57.865Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0605857e136ac0c0b973eb8ac207663b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.879Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f03710f9623e370b4f964557: done: 0.090734 sec","job_status":"done","queue_duration_s":3.708626,"scheduling_latency_s":3.708756,"redis_calls":9,"redis_duration_s":0.004653,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001224,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002387,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090734,"completed_at":"2026-09-04T07:48:01.678Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2433gitlab # [ 507.137404] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.682Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6dbf0baf82ee63f135ffb4a4","created_at":"2026-09-04T07:47:57.887Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.908Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6dbf0baf82ee63f135ffb4a4: start","job_status":"start","queue_duration_s":3.773545,"scheduling_latency_s":3.77361}2434gitlab # [ 507.190562] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.775Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6dbf0baf82ee63f135ffb4a4","created_at":"2026-09-04T07:47:57.887Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.908Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6dbf0baf82ee63f135ffb4a4: done: 0.092976 sec","job_status":"done","queue_duration_s":3.773545,"scheduling_latency_s":3.77361,"redis_calls":7,"redis_duration_s":0.006383,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092976,"completed_at":"2026-09-04T07:48:01.775Z","load_balancing_strategy":"primary","db_duration_s":0.02025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2435gitlab # [ 507.270770] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.778Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a95b9ecfade0a039c32952ab","created_at":"2026-09-04T07:47:57.906Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"222ab84eca10188bd4fa4d0d19672000","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.943Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a95b9ecfade0a039c32952ab: start","job_status":"start","queue_duration_s":3.834705,"scheduling_latency_s":3.834744}2436gitlab # [ 507.364322] gitaly[1041]: time="2026-09-04T07:48:01.948Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP73JPSK2BE07NP3WDW13C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:31.744" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:01.945" grpc.time_ms=2.381 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2437gitlab # [ 507.381339] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.954Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a95b9ecfade0a039c32952ab","created_at":"2026-09-04T07:47:57.906Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"222ab84eca10188bd4fa4d0d19672000","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.943Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a95b9ecfade0a039c32952ab: done: 0.175937 sec","job_status":"done","queue_duration_s":3.834705,"scheduling_latency_s":3.834744,"redis_calls":11,"redis_duration_s":0.005438,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000914,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.062,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0014665,"exclusive_lock_hold_duration_s":0.09084692,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.175937,"completed_at":"2026-09-04T07:48:01.954Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.063934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2438gitlab # [ 507.428353] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:01.958Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"66d97737dc9cde2fde968f6b","created_at":"2026-09-04T07:47:57.941Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.948Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-66d97737dc9cde2fde968f6b: start","job_status":"start","queue_duration_s":4.010156,"scheduling_latency_s":4.010186}2439gitlab # [ 507.470518] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.054Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"66d97737dc9cde2fde968f6b","created_at":"2026-09-04T07:47:57.941Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.948Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-66d97737dc9cde2fde968f6b: done: 0.096057 sec","job_status":"done","queue_duration_s":4.010156,"scheduling_latency_s":4.010186,"redis_calls":10,"redis_duration_s":0.0065520000000000005,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003353,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002158,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.096057,"completed_at":"2026-09-04T07:48:02.054Z","load_balancing_strategy":"primary","db_duration_s":0.019193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2440gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses, in 0.41 seconds)2441gitlab # [ 507.523623] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.060Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c433b5e55a2e8d99dd4fbd74","created_at":"2026-09-04T07:47:57.950Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.956Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c433b5e55a2e8d99dd4fbd74: start","job_status":"start","queue_duration_s":4.104345,"scheduling_latency_s":4.104387}2442gitlab # [ 507.542083] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:48:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 3432443gitlab # [ 507.557145] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.141Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c433b5e55a2e8d99dd4fbd74","created_at":"2026-09-04T07:47:57.950Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.956Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c433b5e55a2e8d99dd4fbd74: done: 0.081555 sec","job_status":"done","queue_duration_s":4.104345,"scheduling_latency_s":4.104387,"redis_calls":7,"redis_duration_s":0.00517,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.081555,"completed_at":"2026-09-04T07:48:02.141Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2444gitlab # [ 507.603400] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.145Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3205100d72335e6194b48ed0","created_at":"2026-09-04T07:47:57.972Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.986Z","job_size_bytes":19,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3205100d72335e6194b48ed0: start","job_status":"start","queue_duration_s":4.15864,"scheduling_latency_s":4.158671}2445gitlab # [ 507.636635] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3205100d72335e6194b48ed0","created_at":"2026-09-04T07:47:57.972Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.986Z","job_size_bytes":19,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3205100d72335e6194b48ed0: done: 0.075881 sec","job_status":"done","queue_duration_s":4.15864,"scheduling_latency_s":4.158671,"redis_calls":8,"redis_duration_s":0.003417,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00267,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075881,"completed_at":"2026-09-04T07:48:02.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018355,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2446gitlab # [ 507.682526] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"55c5053f6d884adeb0916f1e","created_at":"2026-09-04T07:47:57.973Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9474687d27a80933286845ebd1e78071","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.993Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-55c5053f6d884adeb0916f1e: start","job_status":"start","queue_duration_s":4.230333,"scheduling_latency_s":4.230363}2447gitlab # [ 507.704556] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"55c5053f6d884adeb0916f1e","created_at":"2026-09-04T07:47:57.973Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9474687d27a80933286845ebd1e78071","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:57.993Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-55c5053f6d884adeb0916f1e: done: 0.064835 sec","job_status":"done","queue_duration_s":4.230333,"scheduling_latency_s":4.230363,"redis_calls":11,"redis_duration_s":0.005678,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001366,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001966,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00126716,"exclusive_lock_hold_duration_s":0.01706886,"duration_s":0.064835,"completed_at":"2026-09-04T07:48:02.288Z","load_balancing_strategy":"primary","db_duration_s":0.010597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2448gitlab # [ 507.747537] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.292Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"55ebb0c180880e3ac1919375","created_at":"2026-09-04T07:47:57.991Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.000Z","job_size_bytes":66,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-55ebb0c180880e3ac1919375: start","job_status":"start","queue_duration_s":4.291781,"scheduling_latency_s":4.291845}2449gitlab # [ 507.767780] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.352Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"55ebb0c180880e3ac1919375","created_at":"2026-09-04T07:47:57.991Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.000Z","job_size_bytes":66,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-55ebb0c180880e3ac1919375: done: 0.059991 sec","job_status":"done","queue_duration_s":4.291781,"scheduling_latency_s":4.291845,"redis_calls":7,"redis_duration_s":0.00381,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00286,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059991,"completed_at":"2026-09-04T07:48:02.352Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009766,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2450gitlab # [ 507.811747] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.355Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8a817c081d878a04c04e081d","created_at":"2026-09-04T07:47:58.003Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.009Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8a817c081d878a04c04e081d: start","job_status":"start","queue_duration_s":4.346352,"scheduling_latency_s":4.34638}2451gitlab # [ 507.850705] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.432Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8a817c081d878a04c04e081d","created_at":"2026-09-04T07:47:58.003Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.009Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8a817c081d878a04c04e081d: done: 0.076767 sec","job_status":"done","queue_duration_s":4.346352,"scheduling_latency_s":4.34638,"redis_calls":7,"redis_duration_s":0.003677,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076767,"completed_at":"2026-09-04T07:48:02.432Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2452gitlab # [ 507.893418] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e815014838824364051427be","created_at":"2026-09-04T07:47:58.063Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.078Z","job_size_bytes":6,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e815014838824364051427be: start","job_status":"start","queue_duration_s":4.360018,"scheduling_latency_s":4.360089}2453gitlab # [ 507.909411] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.477Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e815014838824364051427be","created_at":"2026-09-04T07:47:58.063Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.078Z","job_size_bytes":6,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e815014838824364051427be: done: 0.038352 sec","job_status":"done","queue_duration_s":4.360018,"scheduling_latency_s":4.360089,"redis_calls":7,"redis_duration_s":0.006239999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002165,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038352,"completed_at":"2026-09-04T07:48:02.477Z","load_balancing_strategy":"primary","db_duration_s":0.001274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2454gitlab # [ 507.953381] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0f7bb95414926644b1886b7a","created_at":"2026-09-04T07:47:58.083Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.094Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0f7bb95414926644b1886b7a: start","job_status":"start","queue_duration_s":4.385556,"scheduling_latency_s":4.385605}2455gitlab # [ 507.969124] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0f7bb95414926644b1886b7a","created_at":"2026-09-04T07:47:58.083Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.094Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0f7bb95414926644b1886b7a: done: 0.069532 sec","job_status":"done","queue_duration_s":4.385556,"scheduling_latency_s":4.385605,"redis_calls":7,"redis_duration_s":0.003221,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069532,"completed_at":"2026-09-04T07:48:02.549Z","load_balancing_strategy":"primary","db_duration_s":0.02024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2456gitlab # [ 508.011651] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.552Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1ea2f758d9f1a4eb29c0f73a","created_at":"2026-09-04T07:47:58.064Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f080274b9b16cce74604364a903ab96b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.097Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1ea2f758d9f1a4eb29c0f73a: start","job_status":"start","queue_duration_s":4.454715,"scheduling_latency_s":4.454765}2457gitlab # [ 508.026852] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1ea2f758d9f1a4eb29c0f73a","created_at":"2026-09-04T07:47:58.064Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f080274b9b16cce74604364a903ab96b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.097Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1ea2f758d9f1a4eb29c0f73a: done: 0.047027 sec","job_status":"done","queue_duration_s":4.454715,"scheduling_latency_s":4.454765,"redis_calls":11,"redis_duration_s":0.004681,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001594,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000773,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047027,"completed_at":"2026-09-04T07:48:02.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002465,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2458gitlab # [ 508.070200] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f40692b5974f83ddde3ee5f5","created_at":"2026-09-04T07:47:58.139Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.199Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f40692b5974f83ddde3ee5f5: start","job_status":"start","queue_duration_s":4.405018,"scheduling_latency_s":4.405042}2459gitlab # [ 508.087868] nix-daemon[4173]: accepted connection from pid 4918, user nixbot2460gitlab # [ 508.118756] nix-daemon[4173]: accepted connection from pid 4868, user nixbot2461gitlab # [ 508.325675] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f40692b5974f83ddde3ee5f5","created_at":"2026-09-04T07:47:58.139Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.199Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f40692b5974f83ddde3ee5f5: done: 0.304726 sec","job_status":"done","queue_duration_s":4.405018,"scheduling_latency_s":4.405042,"redis_calls":70,"redis_duration_s":0.043946,"redis_read_bytes":118,"redis_write_bytes":42530,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.004621,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00336,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.034384,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.251928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.304726,"completed_at":"2026-09-04T07:48:02.909Z","load_balancing_strategy":"primary","db_duration_s":0.006837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2462gitlab # [ 508.425348] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:02.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"477ea2bbe0f94c9a37f38333","created_at":"2026-09-04T07:47:58.321Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb2a775efa8863c067e69fcb43b36e9b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.392Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-477ea2bbe0f94c9a37f38333: start","job_status":"start","queue_duration_s":4.521741,"scheduling_latency_s":4.521785}2463gitlab # [ 508.443159] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"477ea2bbe0f94c9a37f38333","created_at":"2026-09-04T07:47:58.321Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb2a775efa8863c067e69fcb43b36e9b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.392Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-477ea2bbe0f94c9a37f38333: done: 0.10133 sec","job_status":"done","queue_duration_s":4.521741,"scheduling_latency_s":4.521785,"redis_calls":11,"redis_duration_s":0.008133000000000001,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00175774,"exclusive_lock_hold_duration_s":0.01003042,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.10133,"completed_at":"2026-09-04T07:48:03.015Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2464gitlab # [ 508.487705] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.024Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"785a973a8ee91c33946c5802","created_at":"2026-09-04T07:47:58.565Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.582Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-785a973a8ee91c33946c5802: start","job_status":"start","queue_duration_s":4.442335,"scheduling_latency_s":4.442505}2465gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses2466gitlab # [ 508.615311] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.196Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"785a973a8ee91c33946c5802","created_at":"2026-09-04T07:47:58.565Z","trace_propagation_headers":{"sentry-trace":"8c0f38bf8d50443ea3f793c17ac45963-da128c96637d4218","baggage":"sentry-trace_id=8c0f38bf8d50443ea3f793c17ac45963,sentry-release=Unknown"},"correlation_id":"01M1NP6WR90B8G9M35FGNJRHPP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.582Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-785a973a8ee91c33946c5802: done: 0.172163 sec","job_status":"done","queue_duration_s":4.442335,"scheduling_latency_s":4.442505,"redis_calls":8,"redis_duration_s":0.006136000000000001,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004839,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001297,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.172163,"completed_at":"2026-09-04T07:48:03.196Z","load_balancing_strategy":"primary","db_duration_s":0.025921,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2467gitlab # [ 508.704879] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"87c038e618c2e3c972d78252","created_at":"2026-09-04T07:47:58.507Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05a4806413ebbcb33198f415ccb32971","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:47:58.591Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-87c038e618c2e3c972d78252: start","job_status":"start","queue_duration_s":4.612157,"scheduling_latency_s":4.612211}2468gitlab # [ 508.789674] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.373Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"87c038e618c2e3c972d78252","created_at":"2026-09-04T07:47:58.507Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05a4806413ebbcb33198f415ccb32971","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:47:58.591Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-87c038e618c2e3c972d78252: done: 0.170424 sec","job_status":"done","queue_duration_s":4.612157,"scheduling_latency_s":4.612211,"redis_calls":9,"redis_duration_s":0.024767,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.016559,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006916,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.170424,"completed_at":"2026-09-04T07:48:03.373Z","load_balancing_strategy":"primary","db_duration_s":0.028021,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2469gitlab # [ 508.865523] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f7c08e39bcb81f39593b25c0","created_at":"2026-09-04T07:47:58.647Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0fdefd7aa930f51688595e95905816d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.686Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f7c08e39bcb81f39593b25c0: start","job_status":"start","queue_duration_s":4.692576,"scheduling_latency_s":4.692675}2470gitlab # [ 508.882525] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.415Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2471gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses, in 0.36 seconds)2472gitlab # [ 508.886171] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.433Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f7c08e39bcb81f39593b25c0","created_at":"2026-09-04T07:47:58.647Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0fdefd7aa930f51688595e95905816d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.686Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f7c08e39bcb81f39593b25c0: done: 0.053932 sec","job_status":"done","queue_duration_s":4.692576,"scheduling_latency_s":4.692675,"redis_calls":9,"redis_duration_s":0.005695,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000902,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002548,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053932,"completed_at":"2026-09-04T07:48:03.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001735,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2473gitlab # [ 508.932059] gitaly[1041]: time="2026-09-04T07:48:03.393Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP750VRRWJHC5D4C16G8FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:33.090" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:03.391" grpc.time_ms=1.186 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2474gitlab # [ 508.945595] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:48:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2352475gitlab # [ 508.948286] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"051720e9eae860e8bb9a0fb7","created_at":"2026-09-04T07:47:58.724Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.761Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-051720e9eae860e8bb9a0fb7: start","job_status":"start","queue_duration_s":4.675877,"scheduling_latency_s":4.675966}2476gitlab # [ 508.961297] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"051720e9eae860e8bb9a0fb7","created_at":"2026-09-04T07:47:58.724Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.761Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-051720e9eae860e8bb9a0fb7: done: 0.079654 sec","job_status":"done","queue_duration_s":4.675877,"scheduling_latency_s":4.675966,"redis_calls":18,"redis_duration_s":0.01349,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001771,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000599,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004406,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.006714,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.079654,"completed_at":"2026-09-04T07:48:03.516Z","load_balancing_strategy":"primary","db_duration_s":0.00416,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2477gitlab # [ 509.004713] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:03.519Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"87934ac64093767d6d496993","created_at":"2026-09-04T07:47:58.790Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37c7c06a0d041b73dd63c252b2828209","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.837Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-87934ac64093767d6d496993: start","job_status":"start","queue_duration_s":4.682374,"scheduling_latency_s":4.682401}2478gitlab # [ 509.433252] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"87934ac64093767d6d496993","created_at":"2026-09-04T07:47:58.790Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37c7c06a0d041b73dd63c252b2828209","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.837Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-87934ac64093767d6d496993: done: 0.498034 sec","job_status":"done","queue_duration_s":4.682374,"scheduling_latency_s":4.682401,"redis_calls":564,"redis_duration_s":0.105754,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000781,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.103576,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.435785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.498034,"completed_at":"2026-09-04T07:48:04.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2479gitlab # [ 509.509168] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d143c9af27943389db3483f5","created_at":"2026-09-04T07:47:58.898Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99ccc1baa9f985b3935c56d552542945","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.960Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d143c9af27943389db3483f5: start","job_status":"start","queue_duration_s":5.059544,"scheduling_latency_s":5.059572}2480gitlab # [ 509.525179] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.037Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2481gitlab # [ 509.528579] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d143c9af27943389db3483f5","created_at":"2026-09-04T07:47:58.898Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99ccc1baa9f985b3935c56d552542945","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:58.960Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d143c9af27943389db3483f5: done: 0.027715 sec","job_status":"done","queue_duration_s":5.059544,"scheduling_latency_s":5.059572,"redis_calls":9,"redis_duration_s":0.002379,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000613,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000488,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027715,"completed_at":"2026-09-04T07:48:04.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2482gitlab # [ 509.570657] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2b9891258daf3111e861479c","created_at":"2026-09-04T07:47:59.079Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f302ccdfe3ee2b668f7131f0e0acf0b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:47:59.130Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2b9891258daf3111e861479c: start","job_status":"start","queue_duration_s":4.91868,"scheduling_latency_s":4.9187}2483gitlab # [ 509.584823] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.064Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2484gitlab # [ 509.587978] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.073Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2b9891258daf3111e861479c","created_at":"2026-09-04T07:47:59.079Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f302ccdfe3ee2b668f7131f0e0acf0b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:47:59.130Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2b9891258daf3111e861479c: done: 0.024615 sec","job_status":"done","queue_duration_s":4.91868,"scheduling_latency_s":4.9187,"redis_calls":9,"redis_duration_s":0.002345,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024615,"completed_at":"2026-09-04T07:48:04.073Z","load_balancing_strategy":"primary","db_duration_s":0.000789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2485gitlab # [ 509.629024] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e052098b1891ab2a0a6f5921","created_at":"2026-09-04T07:47:59.178Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"076af1d5d31585f1992b58fd93afb776","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.221Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e052098b1891ab2a0a6f5921: start","job_status":"start","queue_duration_s":4.854094,"scheduling_latency_s":4.854112}2486gitlab # [ 509.642972] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e052098b1891ab2a0a6f5921","created_at":"2026-09-04T07:47:59.178Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"076af1d5d31585f1992b58fd93afb776","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.221Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e052098b1891ab2a0a6f5921: done: 0.024788 sec","job_status":"done","queue_duration_s":4.854094,"scheduling_latency_s":4.854112,"redis_calls":9,"redis_duration_s":0.002155,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024788,"completed_at":"2026-09-04T07:48:04.100Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2487gitlab # [ 509.684541] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.102Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"27b9dc85c1a3a9b5d19b82a4","created_at":"2026-09-04T07:47:59.276Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"931849101613eb2b5318bfe804caaa67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.324Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-27b9dc85c1a3a9b5d19b82a4: start","job_status":"start","queue_duration_s":4.77775,"scheduling_latency_s":4.777769}2488gitlab # [ 509.787319] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.372Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"27b9dc85c1a3a9b5d19b82a4","created_at":"2026-09-04T07:47:59.276Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"931849101613eb2b5318bfe804caaa67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.324Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-27b9dc85c1a3a9b5d19b82a4: done: 0.270029 sec","job_status":"done","queue_duration_s":4.77775,"scheduling_latency_s":4.777769,"redis_calls":13,"redis_duration_s":0.003216,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001066,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.196749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057866,"exclusive_lock_hold_duration_s":0.24175862,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.270029,"completed_at":"2026-09-04T07:48:04.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.078905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2489gitlab # [ 509.865666] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.374Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"78abf8a0e405b43004bd5a9d","created_at":"2026-09-04T07:47:59.376Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93b0c697febb3e0affc96e8dfc2319a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.442Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-78abf8a0e405b43004bd5a9d: start","job_status":"start","queue_duration_s":4.932165,"scheduling_latency_s":4.932184}2490gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses2491gitlab # [ 509.881905] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"78abf8a0e405b43004bd5a9d","created_at":"2026-09-04T07:47:59.376Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93b0c697febb3e0affc96e8dfc2319a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.442Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-78abf8a0e405b43004bd5a9d: done: 0.063153 sec","job_status":"done","queue_duration_s":4.932165,"scheduling_latency_s":4.932184,"redis_calls":13,"redis_duration_s":0.003647,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001102,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001315,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005639,"exclusive_lock_hold_duration_s":0.0352119,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.063153,"completed_at":"2026-09-04T07:48:04.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2492gitlab # [ 509.925812] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"08aa156f1fb554430bf744db","created_at":"2026-09-04T07:47:59.557Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d68eed840801c1ab9ba046bfdf903ee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.634Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-08aa156f1fb554430bf744db: start","job_status":"start","queue_duration_s":4.804669,"scheduling_latency_s":4.804686}2493gitlab # [ 509.940122] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.459Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2494gitlab # [ 509.943565] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.480Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"08aa156f1fb554430bf744db","created_at":"2026-09-04T07:47:59.557Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d68eed840801c1ab9ba046bfdf903ee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.634Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-08aa156f1fb554430bf744db: done: 0.041575 sec","job_status":"done","queue_duration_s":4.804669,"scheduling_latency_s":4.804686,"redis_calls":9,"redis_duration_s":0.003579,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000956,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002004,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041575,"completed_at":"2026-09-04T07:48:04.480Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2495gitlab # [ 509.986345] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.484Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a6a1d465e69efe4d144213fa","created_at":"2026-09-04T07:47:59.711Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89a914363827262010ea222c8dedc3e4","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.751Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a6a1d465e69efe4d144213fa: start","job_status":"start","queue_duration_s":4.73204,"scheduling_latency_s":4.73208}2496gitlab # [ 510.000400] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.543Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a6a1d465e69efe4d144213fa","created_at":"2026-09-04T07:47:59.711Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89a914363827262010ea222c8dedc3e4","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.751Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a6a1d465e69efe4d144213fa: done: 0.059992 sec","job_status":"done","queue_duration_s":4.73204,"scheduling_latency_s":4.73208,"redis_calls":9,"redis_duration_s":0.004132,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001569,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059992,"completed_at":"2026-09-04T07:48:04.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2497gitlab # [ 510.041515] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"80f0c73ccad069f25dfd06b0","created_at":"2026-09-04T07:47:59.846Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b2eeac54b76670bf84daf86b3152515","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.870Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-80f0c73ccad069f25dfd06b0: start","job_status":"start","queue_duration_s":4.67641,"scheduling_latency_s":4.676442}2498gitlab # [ 510.055239] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"80f0c73ccad069f25dfd06b0","created_at":"2026-09-04T07:47:59.846Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b2eeac54b76670bf84daf86b3152515","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.870Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-80f0c73ccad069f25dfd06b0: done: 0.057402 sec","job_status":"done","queue_duration_s":4.67641,"scheduling_latency_s":4.676442,"redis_calls":9,"redis_duration_s":0.002332,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00054,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.057402,"completed_at":"2026-09-04T07:48:04.603Z","load_balancing_strategy":"primary","db_duration_s":0.019313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2499gitlab # [ 510.097773] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e79ee178aa8121f027ca1fd8","created_at":"2026-09-04T07:47:59.893Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91484ade1bfb8f182adfe296108a3fd9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.933Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e79ee178aa8121f027ca1fd8: start","job_status":"start","queue_duration_s":4.673418,"scheduling_latency_s":4.673452}2500gitlab # [ 510.112290] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.626Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2501gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses, in 0.25 seconds)2502gitlab # [ 510.116031] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e79ee178aa8121f027ca1fd8","created_at":"2026-09-04T07:47:59.893Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91484ade1bfb8f182adfe296108a3fd9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:59.933Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e79ee178aa8121f027ca1fd8: done: 0.03037 sec","job_status":"done","queue_duration_s":4.673418,"scheduling_latency_s":4.673452,"redis_calls":9,"redis_duration_s":0.002094,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03037,"completed_at":"2026-09-04T07:48:04.636Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2503gitlab # [ 510.158619] gitaly[1041]: time="2026-09-04T07:48:04.650Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP76AB0FST6R4SJWXGNPT7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:34.447" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:04.648" grpc.time_ms=1.579 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2504gitlab # [ 510.171630] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:48:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1412505gitlab # [ 510.174343] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.639Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4d748c4ca264eb873c397ed2","created_at":"2026-09-04T07:48:00.820Z","trace_propagation_headers":{"sentry-trace":"d515a9860acf44059c444aff769f4052-80432f3572c04faf","baggage":"sentry-trace_id=d515a9860acf44059c444aff769f4052,sentry-release=Unknown"},"correlation_id":"01M1NP6YP9WE6FGWTNZ79VT0GV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:00.826Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4d748c4ca264eb873c397ed2: start","job_status":"start","queue_duration_s":3.812978,"scheduling_latency_s":3.813008}2506gitlab # [ 510.191487] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"4d748c4ca264eb873c397ed2","created_at":"2026-09-04T07:48:00.820Z","trace_propagation_headers":{"sentry-trace":"d515a9860acf44059c444aff769f4052-80432f3572c04faf","baggage":"sentry-trace_id=d515a9860acf44059c444aff769f4052,sentry-release=Unknown"},"correlation_id":"01M1NP6YP9WE6FGWTNZ79VT0GV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:00.826Z","job_size_bytes":3,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4d748c4ca264eb873c397ed2: done: 0.064307 sec","job_status":"done","queue_duration_s":3.812978,"scheduling_latency_s":3.813008,"redis_calls":7,"redis_duration_s":0.001545,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064307,"completed_at":"2026-09-04T07:48:04.703Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2507gitlab # [ 510.233692] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed11b34e4704ef3d805c8a00","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed11b34e4704ef3d805c8a00: start","job_status":"start","queue_duration_s":1.842354,"scheduling_latency_s":1.842379}2508gitlab # [ 510.270936] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed11b34e4704ef3d805c8a00","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed11b34e4704ef3d805c8a00: done: 0.030025 sec","job_status":"done","queue_duration_s":1.842354,"scheduling_latency_s":1.842379,"redis_calls":15,"redis_duration_s":0.0041329999999999995,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000583,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001272,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002278,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030025,"completed_at":"2026-09-04T07:48:04.735Z","load_balancing_strategy":"primary","db_duration_s":0.000835,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2509gitlab # [ 510.339979] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a9743b42fef868f4b5ee1bb","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a9743b42fef868f4b5ee1bb: start","job_status":"start","queue_duration_s":1.873994,"scheduling_latency_s":1.874033}2510gitlab # [ 510.353667] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a9743b42fef868f4b5ee1bb","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a9743b42fef868f4b5ee1bb: done: 0.017795 sec","job_status":"done","queue_duration_s":1.873994,"scheduling_latency_s":1.874033,"redis_calls":13,"redis_duration_s":0.00284,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017795,"completed_at":"2026-09-04T07:48:04.754Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2511gitlab # [ 510.392870] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58d263815db7da75f167c753","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58d263815db7da75f167c753: start","job_status":"start","queue_duration_s":1.893271,"scheduling_latency_s":1.893288}2512gitlab # [ 510.406210] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58d263815db7da75f167c753","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58d263815db7da75f167c753: done: 0.016385 sec","job_status":"done","queue_duration_s":1.893271,"scheduling_latency_s":1.893288,"redis_calls":13,"redis_duration_s":0.003016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016385,"completed_at":"2026-09-04T07:48:04.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2513gitlab # [ 510.445399] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcbe674dadcce04964005679","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcbe674dadcce04964005679: start","job_status":"start","queue_duration_s":1.911114,"scheduling_latency_s":1.91113}2514gitlab # [ 510.458217] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcbe674dadcce04964005679","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcbe674dadcce04964005679: done: 0.015049 sec","job_status":"done","queue_duration_s":1.911114,"scheduling_latency_s":1.91113,"redis_calls":13,"redis_duration_s":0.002591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001651,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015049,"completed_at":"2026-09-04T07:48:04.789Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2515gitlab # [ 510.496422] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d46e38c1dadd0ca1543014e","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d46e38c1dadd0ca1543014e: start","job_status":"start","queue_duration_s":1.927501,"scheduling_latency_s":1.927517}2516gitlab # [ 510.508445] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d46e38c1dadd0ca1543014e","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d46e38c1dadd0ca1543014e: done: 0.01495 sec","job_status":"done","queue_duration_s":1.927501,"scheduling_latency_s":1.927517,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01495,"completed_at":"2026-09-04T07:48:04.805Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2517gitlab # [ 510.546828] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f1cc3abbffcc9edb67af94a","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f1cc3abbffcc9edb67af94a: start","job_status":"start","queue_duration_s":1.943886,"scheduling_latency_s":1.943901}2518gitlab # [ 510.559055] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f1cc3abbffcc9edb67af94a","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f1cc3abbffcc9edb67af94a: done: 0.015115 sec","job_status":"done","queue_duration_s":1.943886,"scheduling_latency_s":1.943901,"redis_calls":13,"redis_duration_s":0.002702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015115,"completed_at":"2026-09-04T07:48:04.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2519gitlab # [ 510.597312] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17527bbc27d8bdd56567b170","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17527bbc27d8bdd56567b170: start","job_status":"start","queue_duration_s":1.960468,"scheduling_latency_s":1.960484}2520gitlab # [ 510.610502] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17527bbc27d8bdd56567b170","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17527bbc27d8bdd56567b170: done: 0.015199 sec","job_status":"done","queue_duration_s":1.960468,"scheduling_latency_s":1.960484,"redis_calls":13,"redis_duration_s":0.002822,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015199,"completed_at":"2026-09-04T07:48:04.838Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2521gitlab # [ 510.649396] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"339b87bfe2e10aa329b2678e","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-339b87bfe2e10aa329b2678e: start","job_status":"start","queue_duration_s":1.977004,"scheduling_latency_s":1.97702}2522gitlab # [ 510.661448] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"339b87bfe2e10aa329b2678e","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-339b87bfe2e10aa329b2678e: done: 0.01481 sec","job_status":"done","queue_duration_s":1.977004,"scheduling_latency_s":1.97702,"redis_calls":13,"redis_duration_s":0.002656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01481,"completed_at":"2026-09-04T07:48:04.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2523gitlab # [ 510.699835] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"920e557f4f2245945a49a83b","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-920e557f4f2245945a49a83b: start","job_status":"start","queue_duration_s":1.993208,"scheduling_latency_s":1.993223}2524gitlab # [ 510.712204] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"920e557f4f2245945a49a83b","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-920e557f4f2245945a49a83b: done: 0.06017 sec","job_status":"done","queue_duration_s":1.993208,"scheduling_latency_s":1.993223,"redis_calls":13,"redis_duration_s":0.035648,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002417,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.033231,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.06017,"completed_at":"2026-09-04T07:48:04.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2525gitlab # [ 510.750199] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b2c469ce0e9900b4d46af94","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b2c469ce0e9900b4d46af94: start","job_status":"start","queue_duration_s":2.060767,"scheduling_latency_s":2.060797}2526gitlab # [ 510.762387] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b2c469ce0e9900b4d46af94","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b2c469ce0e9900b4d46af94: done: 0.059055 sec","job_status":"done","queue_duration_s":2.060767,"scheduling_latency_s":2.060797,"redis_calls":13,"redis_duration_s":0.021290999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.059055,"completed_at":"2026-09-04T07:48:04.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2527gitlab # [ 510.800512] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:04.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2886e0225d6df7b8b2cbee2f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2886e0225d6df7b8b2cbee2f: start","job_status":"start","queue_duration_s":2.134787,"scheduling_latency_s":2.134826}2528gitlab # [ 510.812579] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2886e0225d6df7b8b2cbee2f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2886e0225d6df7b8b2cbee2f: done: 0.1221 sec","job_status":"done","queue_duration_s":2.134787,"scheduling_latency_s":2.134826,"redis_calls":13,"redis_duration_s":0.022490999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.013406,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.1221,"completed_at":"2026-09-04T07:48:05.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2529gitlab # [ 510.851809] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da8260de150c1165c398b940","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da8260de150c1165c398b940: start","job_status":"start","queue_duration_s":2.262929,"scheduling_latency_s":2.262974}2530gitlab # [ 510.864164] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da8260de150c1165c398b940","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da8260de150c1165c398b940: done: 0.125204 sec","job_status":"done","queue_duration_s":2.262929,"scheduling_latency_s":2.262974,"redis_calls":13,"redis_duration_s":0.028767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.014232,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014535,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.125204,"completed_at":"2026-09-04T07:48:05.250Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2531gitlab # [ 510.902016] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fdeb9716575c62447151646","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fdeb9716575c62447151646: start","job_status":"start","queue_duration_s":2.397359,"scheduling_latency_s":2.397404}2532gitlab # [ 510.914136] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fdeb9716575c62447151646","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fdeb9716575c62447151646: done: 0.118124 sec","job_status":"done","queue_duration_s":2.397359,"scheduling_latency_s":2.397404,"redis_calls":13,"redis_duration_s":0.027282,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.018542,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.118124,"completed_at":"2026-09-04T07:48:05.378Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2533gitlab # [ 510.952165] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4980786a905b24acbe07b0bc","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4980786a905b24acbe07b0bc: start","job_status":"start","queue_duration_s":2.523107,"scheduling_latency_s":2.52316}2534gitlab # [ 510.963987] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4980786a905b24acbe07b0bc","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4980786a905b24acbe07b0bc: done: 0.11165 sec","job_status":"done","queue_duration_s":2.523107,"scheduling_latency_s":2.52316,"redis_calls":13,"redis_duration_s":0.025516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.010059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.015457,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.11165,"completed_at":"2026-09-04T07:48:05.497Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2535gitlab # [ 511.002184] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00e92c4de4ef6f80d1dbf5db","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00e92c4de4ef6f80d1dbf5db: start","job_status":"start","queue_duration_s":2.644613,"scheduling_latency_s":2.644655}2536gitlab # [ 511.058756] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00e92c4de4ef6f80d1dbf5db","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00e92c4de4ef6f80d1dbf5db: done: 0.135775 sec","job_status":"done","queue_duration_s":2.644613,"scheduling_latency_s":2.644655,"redis_calls":13,"redis_duration_s":0.040277,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006245,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.034032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.135775,"completed_at":"2026-09-04T07:48:05.643Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2537gitlab # [ 511.107231] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84e8ef37d19a65f67028e1f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84e8ef37d19a65f67028e1f: start","job_status":"start","queue_duration_s":2.784108,"scheduling_latency_s":2.784152}2538gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses2539gitlab # [ 511.120149] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b84e8ef37d19a65f67028e1f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b84e8ef37d19a65f67028e1f: done: 0.037078 sec","job_status":"done","queue_duration_s":2.784108,"scheduling_latency_s":2.784152,"redis_calls":13,"redis_duration_s":0.004477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037078,"completed_at":"2026-09-04T07:48:05.683Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2540gitlab # [ 511.157794] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"626157e320d9c4e4a5d82aa2","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-626157e320d9c4e4a5d82aa2: start","job_status":"start","queue_duration_s":2.823756,"scheduling_latency_s":2.823788}2541gitlab # [ 511.169062] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"626157e320d9c4e4a5d82aa2","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-626157e320d9c4e4a5d82aa2: done: 0.026393 sec","job_status":"done","queue_duration_s":2.823756,"scheduling_latency_s":2.823788,"redis_calls":13,"redis_duration_s":0.0034070000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001207,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026393,"completed_at":"2026-09-04T07:48:05.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2542gitlab # [ 511.206146] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf66f28fd0deb81d102ba176","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf66f28fd0deb81d102ba176: start","job_status":"start","queue_duration_s":2.852088,"scheduling_latency_s":2.852114}2543gitlab # [ 511.218334] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf66f28fd0deb81d102ba176","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf66f28fd0deb81d102ba176: done: 0.021053 sec","job_status":"done","queue_duration_s":2.852088,"scheduling_latency_s":2.852114,"redis_calls":13,"redis_duration_s":0.002951,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021053,"completed_at":"2026-09-04T07:48:05.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2544gitlab # [ 511.257516] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31a4dd9940253dcc579615fd","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31a4dd9940253dcc579615fd: start","job_status":"start","queue_duration_s":2.874817,"scheduling_latency_s":2.874837}2545gitlab # [ 511.269686] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31a4dd9940253dcc579615fd","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31a4dd9940253dcc579615fd: done: 0.034899 sec","job_status":"done","queue_duration_s":2.874817,"scheduling_latency_s":2.874837,"redis_calls":13,"redis_duration_s":0.004975,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001763,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034899,"completed_at":"2026-09-04T07:48:05.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2546gitlab # [ 511.308296] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37123dcf1cbe156bde628afa","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37123dcf1cbe156bde628afa: start","job_status":"start","queue_duration_s":2.913406,"scheduling_latency_s":2.913456}2547gitlab # [ 511.320401] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37123dcf1cbe156bde628afa","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37123dcf1cbe156bde628afa: done: 0.036558 sec","job_status":"done","queue_duration_s":2.913406,"scheduling_latency_s":2.913456,"redis_calls":13,"redis_duration_s":0.003521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001294,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002227,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036558,"completed_at":"2026-09-04T07:48:05.812Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2548gitlab # [ 511.359240] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6761fe43df6e1fb37aed1f2","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6761fe43df6e1fb37aed1f2: start","job_status":"start","queue_duration_s":2.951712,"scheduling_latency_s":2.951738}2549gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses, in 0.24 seconds)2550gitlab # [ 511.371616] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6761fe43df6e1fb37aed1f2","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6761fe43df6e1fb37aed1f2: done: 0.024097 sec","job_status":"done","queue_duration_s":2.951712,"scheduling_latency_s":2.951738,"redis_calls":13,"redis_duration_s":0.003412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024097,"completed_at":"2026-09-04T07:48:05.838Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2551gitlab # [ 511.409558] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de2dcef7fce85ef07483614f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de2dcef7fce85ef07483614f: start","job_status":"start","queue_duration_s":2.977625,"scheduling_latency_s":2.977646}2552gitlab # [ 511.421923] gitaly[1041]: time="2026-09-04T07:48:05.921Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP77J03NS8AYP2Y5MXETJD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:35.619" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:05.919" grpc.time_ms=1.164 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2553gitlab # [ 511.435873] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:48:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1332554gitlab # [ 511.438613] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de2dcef7fce85ef07483614f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de2dcef7fce85ef07483614f: done: 0.024501 sec","job_status":"done","queue_duration_s":2.977625,"scheduling_latency_s":2.977646,"redis_calls":13,"redis_duration_s":0.0034210000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024501,"completed_at":"2026-09-04T07:48:05.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2555gitlab # [ 511.477133] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d42496193ab71c90abe44f7a","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d42496193ab71c90abe44f7a: start","job_status":"start","queue_duration_s":3.004059,"scheduling_latency_s":3.00408}2556gitlab # [ 511.489134] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d42496193ab71c90abe44f7a","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d42496193ab71c90abe44f7a: done: 0.020139 sec","job_status":"done","queue_duration_s":3.004059,"scheduling_latency_s":3.00408,"redis_calls":13,"redis_duration_s":0.003053,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020139,"completed_at":"2026-09-04T07:48:05.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2557gitlab # [ 511.527209] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f60d4b0aca0b6633f9e19c76","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f60d4b0aca0b6633f9e19c76: start","job_status":"start","queue_duration_s":3.025843,"scheduling_latency_s":3.025863}2558gitlab # [ 511.539554] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f60d4b0aca0b6633f9e19c76","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f60d4b0aca0b6633f9e19c76: done: 0.016915 sec","job_status":"done","queue_duration_s":3.025843,"scheduling_latency_s":3.025863,"redis_calls":13,"redis_duration_s":0.0020410000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016915,"completed_at":"2026-09-04T07:48:05.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2559gitlab # [ 511.577880] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30cff816e6c949a7941bbeea","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30cff816e6c949a7941bbeea: start","job_status":"start","queue_duration_s":3.044002,"scheduling_latency_s":3.04402}2560gitlab # [ 511.590003] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30cff816e6c949a7941bbeea","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30cff816e6c949a7941bbeea: done: 0.019576 sec","job_status":"done","queue_duration_s":3.044002,"scheduling_latency_s":3.04402,"redis_calls":13,"redis_duration_s":0.004712999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019576,"completed_at":"2026-09-04T07:48:05.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2561gitlab # [ 511.629417] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73700f1883ccc37c37ef0f64","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73700f1883ccc37c37ef0f64: start","job_status":"start","queue_duration_s":3.064877,"scheduling_latency_s":3.064895}2562gitlab # [ 511.641408] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73700f1883ccc37c37ef0f64","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73700f1883ccc37c37ef0f64: done: 0.016627 sec","job_status":"done","queue_duration_s":3.064877,"scheduling_latency_s":3.064895,"redis_calls":13,"redis_duration_s":0.001874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016627,"completed_at":"2026-09-04T07:48:05.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2563gitlab # [ 511.680229] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f71739a048dd85ed89beb67","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f71739a048dd85ed89beb67: start","job_status":"start","queue_duration_s":3.082963,"scheduling_latency_s":3.082982}2564gitlab # [ 511.692171] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f71739a048dd85ed89beb67","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f71739a048dd85ed89beb67: done: 0.021829 sec","job_status":"done","queue_duration_s":3.082963,"scheduling_latency_s":3.082982,"redis_calls":13,"redis_duration_s":0.0024070000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001647,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021829,"completed_at":"2026-09-04T07:48:05.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2565gitlab # [ 511.730481] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb9195576eaed4e81684ecc4","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb9195576eaed4e81684ecc4: start","job_status":"start","queue_duration_s":3.106279,"scheduling_latency_s":3.106298}2566gitlab # [ 511.742707] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb9195576eaed4e81684ecc4","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb9195576eaed4e81684ecc4: done: 0.018151 sec","job_status":"done","queue_duration_s":3.106279,"scheduling_latency_s":3.106298,"redis_calls":13,"redis_duration_s":0.002182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001457,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018151,"completed_at":"2026-09-04T07:48:05.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2567gitlab # [ 511.780714] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:05.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93e003c45c3f9a71357e6237","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93e003c45c3f9a71357e6237: start","job_status":"start","queue_duration_s":3.125871,"scheduling_latency_s":3.12589}2568gitlab # [ 511.792750] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93e003c45c3f9a71357e6237","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93e003c45c3f9a71357e6237: done: 0.017344 sec","job_status":"done","queue_duration_s":3.125871,"scheduling_latency_s":3.12589,"redis_calls":13,"redis_duration_s":0.0022689999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001486,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017344,"completed_at":"2026-09-04T07:48:06.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2569gitlab # [ 511.831047] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f161fe47b4f1ecc77aae431b","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f161fe47b4f1ecc77aae431b: start","job_status":"start","queue_duration_s":3.14459,"scheduling_latency_s":3.144607}2570gitlab # [ 511.844452] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f161fe47b4f1ecc77aae431b","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f161fe47b4f1ecc77aae431b: done: 0.016143 sec","job_status":"done","queue_duration_s":3.14459,"scheduling_latency_s":3.144607,"redis_calls":13,"redis_duration_s":0.002895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001316,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001579,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016143,"completed_at":"2026-09-04T07:48:06.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2571gitlab # [ 511.882672] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f96a70b76acf86ca72079785","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f96a70b76acf86ca72079785: start","job_status":"start","queue_duration_s":3.161971,"scheduling_latency_s":3.161999}2572gitlab # [ 511.894883] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f96a70b76acf86ca72079785","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f96a70b76acf86ca72079785: done: 0.015551 sec","job_status":"done","queue_duration_s":3.161971,"scheduling_latency_s":3.161999,"redis_calls":13,"redis_duration_s":0.0026820000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015551,"completed_at":"2026-09-04T07:48:06.040Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2573gitlab # [ 511.932852] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0829b23a1bd539610db328d","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0829b23a1bd539610db328d: start","job_status":"start","queue_duration_s":3.178984,"scheduling_latency_s":3.179004}2574gitlab # [ 511.944899] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0829b23a1bd539610db328d","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0829b23a1bd539610db328d: done: 0.015632 sec","job_status":"done","queue_duration_s":3.178984,"scheduling_latency_s":3.179004,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015632,"completed_at":"2026-09-04T07:48:06.057Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2575gitlab # [ 511.983027] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c3fa7325c1576aaa4fc4e2","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c3fa7325c1576aaa4fc4e2: start","job_status":"start","queue_duration_s":3.195966,"scheduling_latency_s":3.195981}2576gitlab # [ 511.995317] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c3fa7325c1576aaa4fc4e2","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c3fa7325c1576aaa4fc4e2: done: 0.015028 sec","job_status":"done","queue_duration_s":3.195966,"scheduling_latency_s":3.195981,"redis_calls":13,"redis_duration_s":0.002863,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015028,"completed_at":"2026-09-04T07:48:06.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2577gitlab # [ 512.034143] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4953f0b8e00669aa2396552f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4953f0b8e00669aa2396552f: start","job_status":"start","queue_duration_s":3.212391,"scheduling_latency_s":3.212407}2578gitlab # [ 512.047404] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4953f0b8e00669aa2396552f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4953f0b8e00669aa2396552f: done: 0.014898 sec","job_status":"done","queue_duration_s":3.212391,"scheduling_latency_s":3.212407,"redis_calls":13,"redis_duration_s":0.00267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001753,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014898,"completed_at":"2026-09-04T07:48:06.090Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2579gitlab # [ 512.086524] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2feaf4e961e2e3c1c06b949","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2feaf4e961e2e3c1c06b949: start","job_status":"start","queue_duration_s":3.22861,"scheduling_latency_s":3.228624}2580gitlab # [ 512.098596] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2feaf4e961e2e3c1c06b949","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2feaf4e961e2e3c1c06b949: done: 0.020436 sec","job_status":"done","queue_duration_s":3.22861,"scheduling_latency_s":3.228624,"redis_calls":13,"redis_duration_s":0.007501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002149,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005352,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020436,"completed_at":"2026-09-04T07:48:06.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2581gitlab # [ 512.137454] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00cae5e02b4fc8c0baf3814c","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00cae5e02b4fc8c0baf3814c: start","job_status":"start","queue_duration_s":3.250569,"scheduling_latency_s":3.250586}2582gitlab # [ 512.149702] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00cae5e02b4fc8c0baf3814c","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00cae5e02b4fc8c0baf3814c: done: 0.015588 sec","job_status":"done","queue_duration_s":3.250569,"scheduling_latency_s":3.250586,"redis_calls":13,"redis_duration_s":0.002979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015588,"completed_at":"2026-09-04T07:48:06.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2583gitlab # [ 512.189195] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec8ef5ebc36a1e4a708edb3e","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec8ef5ebc36a1e4a708edb3e: start","job_status":"start","queue_duration_s":3.267637,"scheduling_latency_s":3.267652}2584gitlab # [ 512.226043] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec8ef5ebc36a1e4a708edb3e","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec8ef5ebc36a1e4a708edb3e: done: 0.014874 sec","job_status":"done","queue_duration_s":3.267637,"scheduling_latency_s":3.267652,"redis_calls":13,"redis_duration_s":0.002678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014874,"completed_at":"2026-09-04T07:48:06.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2585gitlab # [ 512.306310] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f897137af1e53bf10c2fc812","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f897137af1e53bf10c2fc812: start","job_status":"start","queue_duration_s":3.283861,"scheduling_latency_s":3.283876}2586gitlab # [ 512.322172] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f897137af1e53bf10c2fc812","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f897137af1e53bf10c2fc812: done: 0.014783 sec","job_status":"done","queue_duration_s":3.283861,"scheduling_latency_s":3.283876,"redis_calls":13,"redis_duration_s":0.002627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001719,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014783,"completed_at":"2026-09-04T07:48:06.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2587gitlab # [ 512.362746] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"250e439422d91c3dcb4f6149","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-250e439422d91c3dcb4f6149: start","job_status":"start","queue_duration_s":3.300008,"scheduling_latency_s":3.300023}2588gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses2589gitlab # [ 512.375048] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"250e439422d91c3dcb4f6149","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-250e439422d91c3dcb4f6149: done: 0.014992 sec","job_status":"done","queue_duration_s":3.300008,"scheduling_latency_s":3.300023,"redis_calls":13,"redis_duration_s":0.0028120000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014992,"completed_at":"2026-09-04T07:48:06.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2590gitlab # [ 512.411576] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a98002b6b430ae3ac4cfa22b","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a98002b6b430ae3ac4cfa22b: start","job_status":"start","queue_duration_s":3.316432,"scheduling_latency_s":3.316448}2591gitlab # [ 512.423035] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a98002b6b430ae3ac4cfa22b","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a98002b6b430ae3ac4cfa22b: done: 0.015096 sec","job_status":"done","queue_duration_s":3.316432,"scheduling_latency_s":3.316448,"redis_calls":13,"redis_duration_s":0.002903,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015096,"completed_at":"2026-09-04T07:48:06.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2592gitlab # [ 512.462845] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cec71ca41d00f3cacbcda7fe","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cec71ca41d00f3cacbcda7fe: start","job_status":"start","queue_duration_s":3.332914,"scheduling_latency_s":3.33293}2593gitlab # [ 512.478901] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cec71ca41d00f3cacbcda7fe","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cec71ca41d00f3cacbcda7fe: done: 0.014671 sec","job_status":"done","queue_duration_s":3.332914,"scheduling_latency_s":3.33293,"redis_calls":13,"redis_duration_s":0.002724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014671,"completed_at":"2026-09-04T07:48:06.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2594gitlab # [ 512.517747] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8eb27ab391434ccbd4775bb","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8eb27ab391434ccbd4775bb: start","job_status":"start","queue_duration_s":3.348974,"scheduling_latency_s":3.348989}2595gitlab # [ 512.530022] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8eb27ab391434ccbd4775bb","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8eb27ab391434ccbd4775bb: done: 0.015906 sec","job_status":"done","queue_duration_s":3.348974,"scheduling_latency_s":3.348989,"redis_calls":13,"redis_duration_s":0.003392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002371,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015906,"completed_at":"2026-09-04T07:48:06.227Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2596gitlab # [ 512.568610] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5170960814bbd7f346af3168","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5170960814bbd7f346af3168: start","job_status":"start","queue_duration_s":3.366435,"scheduling_latency_s":3.366451}2597gitlab # [ 512.581032] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5170960814bbd7f346af3168","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5170960814bbd7f346af3168: done: 0.015315 sec","job_status":"done","queue_duration_s":3.366435,"scheduling_latency_s":3.366451,"redis_calls":13,"redis_duration_s":0.002569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001635,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015315,"completed_at":"2026-09-04T07:48:06.244Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2598gitlab # [ 512.619807] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acc766596c254b514ebac594","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acc766596c254b514ebac594: start","job_status":"start","queue_duration_s":3.383438,"scheduling_latency_s":3.383455}2599gitlab # [ 512.632393] nix-daemon[4173]: accepted connection from pid 4868, user nixbot2600gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses, in 0.26 seconds)2601gitlab # [ 512.633688] gitaly[1041]: time="2026-09-04T07:48:07.150Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP78RH4GQYK80N4KHDF47B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:37.049" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:07.149" grpc.time_ms=0.613 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2602gitlab # [ 512.645822] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acc766596c254b514ebac594","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acc766596c254b514ebac594: done: 0.015402 sec","job_status":"done","queue_duration_s":3.383438,"scheduling_latency_s":3.383455,"redis_calls":13,"redis_duration_s":0.002702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001754,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015402,"completed_at":"2026-09-04T07:48:06.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2603gitlab # [ 512.685942] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af6695b1d5dd53f42293a9c","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af6695b1d5dd53f42293a9c: start","job_status":"start","queue_duration_s":3.399996,"scheduling_latency_s":3.400011}2604gitlab # [ 512.698201] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:48:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1572605gitlab # [ 512.700807] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af6695b1d5dd53f42293a9c","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af6695b1d5dd53f42293a9c: done: 0.015263 sec","job_status":"done","queue_duration_s":3.399996,"scheduling_latency_s":3.400011,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015263,"completed_at":"2026-09-04T07:48:06.278Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2606gitlab # [ 512.739628] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45047c979cfc24517df0ff61","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45047c979cfc24517df0ff61: start","job_status":"start","queue_duration_s":3.41662,"scheduling_latency_s":3.416635}2607gitlab # [ 512.751965] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45047c979cfc24517df0ff61","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45047c979cfc24517df0ff61: done: 0.015441 sec","job_status":"done","queue_duration_s":3.41662,"scheduling_latency_s":3.416635,"redis_calls":13,"redis_duration_s":0.00291,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015441,"completed_at":"2026-09-04T07:48:06.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2608gitlab # [ 512.790826] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21d0c3b8a046039af3039e43","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21d0c3b8a046039af3039e43: start","job_status":"start","queue_duration_s":3.433394,"scheduling_latency_s":3.433409}2609gitlab # [ 512.803188] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21d0c3b8a046039af3039e43","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21d0c3b8a046039af3039e43: done: 0.015123 sec","job_status":"done","queue_duration_s":3.433394,"scheduling_latency_s":3.433409,"redis_calls":13,"redis_duration_s":0.0026709999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015123,"completed_at":"2026-09-04T07:48:06.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2610gitlab # [ 512.841671] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14f64397307a4265aadb9daf","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14f64397307a4265aadb9daf: start","job_status":"start","queue_duration_s":3.449881,"scheduling_latency_s":3.449896}2611gitlab # [ 512.853953] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14f64397307a4265aadb9daf","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14f64397307a4265aadb9daf: done: 0.016362 sec","job_status":"done","queue_duration_s":3.449881,"scheduling_latency_s":3.449896,"redis_calls":13,"redis_duration_s":0.003449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002329,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016362,"completed_at":"2026-09-04T07:48:06.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2612gitlab # [ 512.893436] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61b5c496eaa8006009ff0959","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61b5c496eaa8006009ff0959: start","job_status":"start","queue_duration_s":3.467597,"scheduling_latency_s":3.467612}2613gitlab # [ 512.905593] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61b5c496eaa8006009ff0959","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61b5c496eaa8006009ff0959: done: 0.015125 sec","job_status":"done","queue_duration_s":3.467597,"scheduling_latency_s":3.467612,"redis_calls":13,"redis_duration_s":0.002717,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015125,"completed_at":"2026-09-04T07:48:06.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2614gitlab # [ 512.944316] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ba2b2f33cfe78d01baa900f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ba2b2f33cfe78d01baa900f: start","job_status":"start","queue_duration_s":3.484278,"scheduling_latency_s":3.484295}2615gitlab # [ 512.956378] gitaly[1041]: time="2026-09-04T07:48:07.469Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP791625R7G5K6MH9MCQ0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:37.166" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:07.467" grpc.time_ms=1.206 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2616gitlab # [ 512.968816] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ba2b2f33cfe78d01baa900f","created_at":"2026-09-04T07:48:02.645Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-3c3ea6b9809144d6","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"33460d001e8551a461456dcbee648582","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:02.862Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ba2b2f33cfe78d01baa900f: done: 0.0153 sec","job_status":"done","queue_duration_s":3.484278,"scheduling_latency_s":3.484295,"redis_calls":13,"redis_duration_s":0.002566,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001624,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0153,"completed_at":"2026-09-04T07:48:06.362Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2617gitlab # [ 513.007195] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.364Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1367e25634206f02833d4f4d","created_at":"2026-09-04T07:48:03.472Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-a7b45bacde0a4b68","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:03.500Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1367e25634206f02833d4f4d: start","job_status":"start","queue_duration_s":2.863992,"scheduling_latency_s":2.864008}2618gitlab # [ 513.019461] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.383Z","message":"No existing merge request to be cleaned up."}2619gitlab # [ 513.021196] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.398Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1367e25634206f02833d4f4d","created_at":"2026-09-04T07:48:03.472Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-a7b45bacde0a4b68","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:03.500Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1367e25634206f02833d4f4d: done: 0.034452 sec","job_status":"done","queue_duration_s":2.863992,"scheduling_latency_s":2.864008,"redis_calls":12,"redis_duration_s":0.003092,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000502,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001569,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034452,"completed_at":"2026-09-04T07:48:06.398Z","load_balancing_strategy":"primary","db_duration_s":0.007334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2620gitlab # [ 513.060757] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.399Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"52577ae4f6a95fdf427567ea","created_at":"2026-09-04T07:48:03.472Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-a7b45bacde0a4b68","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:03.500Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-52577ae4f6a95fdf427567ea: start","job_status":"start","queue_duration_s":2.899805,"scheduling_latency_s":2.899822}2621gitlab # [ 513.072875] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.410Z","message":"No existing merge request to be cleaned up."}2622gitlab # [ 513.074495] gitaly[1041]: time="2026-09-04T07:48:07.567Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP791625R7G5K6MH9MCQ0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:17.197" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:48:07.548" grpc.time_ms=18.926 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2623gitlab # [ 513.088932] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.419Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"52577ae4f6a95fdf427567ea","created_at":"2026-09-04T07:48:03.472Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-a7b45bacde0a4b68","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:03.500Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-52577ae4f6a95fdf427567ea: done: 0.0196 sec","job_status":"done","queue_duration_s":2.899805,"scheduling_latency_s":2.899822,"redis_calls":10,"redis_duration_s":0.0022779999999999996,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0196,"completed_at":"2026-09-04T07:48:06.419Z","load_balancing_strategy":"primary","db_duration_s":0.002405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2624gitlab # [ 513.126924] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.420Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fa0f272a1dd8037c18d05a22","created_at":"2026-09-04T07:48:03.472Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-a7b45bacde0a4b68","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:03.500Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fa0f272a1dd8037c18d05a22: start","job_status":"start","queue_duration_s":2.920756,"scheduling_latency_s":2.920771}2625gitlab # [ 513.139199] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.432Z","message":"No existing merge request to be cleaned up."}2626gitlab # [ 513.141021] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:48:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3382627gitlab # [ 513.143832] nixbot[3929]: {"ts": "2026-09-04T07:48:07.675Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0e4246fe7989959ccaa7a0b477e69c5b50b1944a \"HTTP/1.1 201 Created\""}2628gitlab # [ 513.146666] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.441Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fa0f272a1dd8037c18d05a22","created_at":"2026-09-04T07:48:03.472Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-a7b45bacde0a4b68","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:03.500Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fa0f272a1dd8037c18d05a22: done: 0.020703 sec","job_status":"done","queue_duration_s":2.920756,"scheduling_latency_s":2.920771,"redis_calls":10,"redis_duration_s":0.002454,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001439,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020703,"completed_at":"2026-09-04T07:48:06.441Z","load_balancing_strategy":"primary","db_duration_s":0.00245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2629gitlab # [ 513.184673] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.443Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f411ca231a3c95d7514299ee","created_at":"2026-09-04T07:48:03.472Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-a7b45bacde0a4b68","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:03.500Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f411ca231a3c95d7514299ee: start","job_status":"start","queue_duration_s":2.94306,"scheduling_latency_s":2.943076}2630gitlab # [ 513.196952] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.454Z","message":"No existing merge request to be cleaned up."}2631gitlab # [ 513.198628] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.463Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f411ca231a3c95d7514299ee","created_at":"2026-09-04T07:48:03.472Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-a7b45bacde0a4b68","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"74dce51b9409847e6e70322a0ff5e17e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:48:03.500Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f411ca231a3c95d7514299ee: done: 0.020257 sec","job_status":"done","queue_duration_s":2.94306,"scheduling_latency_s":2.943076,"redis_calls":10,"redis_duration_s":0.002691,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001587,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020257,"completed_at":"2026-09-04T07:48:06.463Z","load_balancing_strategy":"primary","db_duration_s":0.002647,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2632gitlab # [ 513.236741] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"90763de62d0bb2a62ed93386","created_at":"2026-09-04T07:48:04.885Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7ae01cbc4b7b0aa68d4b65d829c9904","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.901Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-90763de62d0bb2a62ed93386: start","job_status":"start","queue_duration_s":1.565465,"scheduling_latency_s":1.56551}2633gitlab # [ 513.250805] gitaly[1041]: time="2026-09-04T07:48:07.752Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP79C22618AA1BSCEYP92F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:37.450" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:07.751" grpc.time_ms=0.799 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2634gitlab # [ 513.263488] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"90763de62d0bb2a62ed93386","created_at":"2026-09-04T07:48:04.885Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7ae01cbc4b7b0aa68d4b65d829c9904","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.901Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-90763de62d0bb2a62ed93386: done: 0.05994 sec","job_status":"done","queue_duration_s":1.565465,"scheduling_latency_s":1.56551,"redis_calls":11,"redis_duration_s":0.005065999999999999,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000854,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001995,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00115576,"exclusive_lock_hold_duration_s":0.01071114,"duration_s":0.05994,"completed_at":"2026-09-04T07:48:06.526Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2635gitlab # [ 513.306964] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"2c732f8a13b051d0d2cb511c","created_at":"2026-09-04T07:48:04.913Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5c90fc29255ef7ef9a81cfd825275b0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.923Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-2c732f8a13b051d0d2cb511c: start","job_status":"start","queue_duration_s":1.607055,"scheduling_latency_s":1.607094}2636gitlab # [ 513.320398] gitaly[1041]: time="2026-09-04T07:48:07.799Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NP79C22618AA1BSCEYP92F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:17.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:48:07.791" grpc.time_ms=8.449 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2637gitlab # [ 513.333566] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:48:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1642638gitlab # [ 513.335941] nixbot[3929]: {"ts": "2026-09-04T07:48:07.850Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0e4246fe7989959ccaa7a0b477e69c5b50b1944a \"HTTP/1.1 201 Created\""}2639gitlab # [ 513.338766] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.912Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"2c732f8a13b051d0d2cb511c","created_at":"2026-09-04T07:48:04.913Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5c90fc29255ef7ef9a81cfd825275b0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.923Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-2c732f8a13b051d0d2cb511c: done: 0.382128 sec","job_status":"done","queue_duration_s":1.607055,"scheduling_latency_s":1.607094,"redis_calls":65,"redis_duration_s":0.02477,"redis_read_bytes":114,"redis_write_bytes":41332,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001849,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000848,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37035,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.020741,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001332,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.35617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038392,"duration_s":0.382128,"completed_at":"2026-09-04T07:48:06.912Z","load_balancing_strategy":"primary","db_duration_s":0.002018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2640gitlab # [ 513.380757] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"dea2dd4757a127955a413ec8","created_at":"2026-09-04T07:48:04.929Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f00f978a035fa32979816e22e9c75e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:48:04.931Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-dea2dd4757a127955a413ec8: start","job_status":"start","queue_duration_s":1.982101,"scheduling_latency_s":1.982122}2641gitlab # [ 513.393971] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.922Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2642gitlab # [ 513.397664] gitaly[1041]: time="2026-09-04T07:48:07.910Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP79HJ5HK444KQ27TEX32W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:37.609" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:48:07.909" grpc.time_ms=0.758 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2643gitlab # [ 513.410203] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"dea2dd4757a127955a413ec8","created_at":"2026-09-04T07:48:04.929Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f00f978a035fa32979816e22e9c75e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:48:04.931Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-dea2dd4757a127955a413ec8: done: 0.01452 sec","job_status":"done","queue_duration_s":1.982101,"scheduling_latency_s":1.982122,"redis_calls":7,"redis_duration_s":0.001815,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01452,"completed_at":"2026-09-04T07:48:06.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2644gitlab # [ 513.449502] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d358f2473d572b3d2bf6f560","created_at":"2026-09-04T07:48:04.947Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a03e571dc57ec6e5ca4fbb1f13525c5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.958Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d358f2473d572b3d2bf6f560: start","job_status":"start","queue_duration_s":1.972209,"scheduling_latency_s":1.972229}2645gitlab # [ 513.464205] gitaly[1041]: time="2026-09-04T07:48:07.951Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP79HJ5HK444KQ27TEX32W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:17.152" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:48:07.943" grpc.time_ms=7.815 pid=1041 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2646gitlab # [ 513.477551] nixbot[3929]: {"ts": "2026-09-04T07:48:08.013Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0e4246fe7989959ccaa7a0b477e69c5b50b1944a \"HTTP/1.1 201 Created\""}2647gitlab # [ 513.480357] gitlab-workhorse[862]: gitlab 2001:db8:1::1 - - [2026/09/04:07:48:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0e4246fe7989959ccaa7a0b477e69c5b50b1944a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1512648gitlab # [ 513.482857] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d358f2473d572b3d2bf6f560","created_at":"2026-09-04T07:48:04.947Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a03e571dc57ec6e5ca4fbb1f13525c5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.958Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d358f2473d572b3d2bf6f560: done: 0.025537 sec","job_status":"done","queue_duration_s":1.972209,"scheduling_latency_s":1.972229,"redis_calls":10,"redis_duration_s":0.00274,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001504,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00703794,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.025537,"completed_at":"2026-09-04T07:48:06.956Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004121,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2649gitlab # [ 513.526563] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.957Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"73c125208071330cbfbd9dee","created_at":"2026-09-04T07:48:04.971Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a999f4a721d47b04f6a6560381e148d1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.976Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-73c125208071330cbfbd9dee: start","job_status":"start","queue_duration_s":1.98185,"scheduling_latency_s":1.981869}2650gitlab # [ 513.540379] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.976Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"73c125208071330cbfbd9dee","created_at":"2026-09-04T07:48:04.971Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a999f4a721d47b04f6a6560381e148d1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.976Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-73c125208071330cbfbd9dee: done: 0.018359 sec","job_status":"done","queue_duration_s":1.98185,"scheduling_latency_s":1.981869,"redis_calls":7,"redis_duration_s":0.00186,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018359,"completed_at":"2026-09-04T07:48:06.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2651gitlab # [ 513.579680] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:06.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a17b4da79e4dbbcff709e70a","created_at":"2026-09-04T07:48:04.992Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"486fdc80476c21756e59cfa1b948c8a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.996Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a17b4da79e4dbbcff709e70a: start","job_status":"start","queue_duration_s":1.981096,"scheduling_latency_s":1.981115}2652gitlab # [ 513.594666] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.035Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a17b4da79e4dbbcff709e70a","created_at":"2026-09-04T07:48:04.992Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"486fdc80476c21756e59cfa1b948c8a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:04.996Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a17b4da79e4dbbcff709e70a: done: 0.057683 sec","job_status":"done","queue_duration_s":1.981096,"scheduling_latency_s":1.981115,"redis_calls":9,"redis_duration_s":0.003169,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001393,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00081508,"exclusive_lock_hold_duration_s":0.02544332,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.057683,"completed_at":"2026-09-04T07:48:07.035Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2653gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses2654gitlab # [ 513.636774] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d4d75b6a1fd52f4bdbd5ea92","created_at":"2026-09-04T07:48:05.009Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"495a212972d1d9ac573843188681b13c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.012Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d4d75b6a1fd52f4bdbd5ea92: start","job_status":"start","queue_duration_s":2.027923,"scheduling_latency_s":2.027974}2655gitlab # [ 513.649615] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d4d75b6a1fd52f4bdbd5ea92","created_at":"2026-09-04T07:48:05.009Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"495a212972d1d9ac573843188681b13c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.012Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d4d75b6a1fd52f4bdbd5ea92: done: 0.040048 sec","job_status":"done","queue_duration_s":2.027923,"scheduling_latency_s":2.027974,"redis_calls":9,"redis_duration_s":0.003411,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001765,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00101578,"exclusive_lock_hold_duration_s":0.00605592,"duration_s":0.040048,"completed_at":"2026-09-04T07:48:07.079Z","load_balancing_strategy":"primary","db_duration_s":0.002127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2656gitlab # [ 513.686388] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"85b51a866b6b9edfa65778e0","created_at":"2026-09-04T07:48:05.038Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3750ac3da0617a02c38c99c93cf45fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.049Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-85b51a866b6b9edfa65778e0: start","job_status":"start","queue_duration_s":2.033032,"scheduling_latency_s":2.033063}2657gitlab # [ 513.703825] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.106Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"85b51a866b6b9edfa65778e0","created_at":"2026-09-04T07:48:05.038Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3750ac3da0617a02c38c99c93cf45fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.049Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-85b51a866b6b9edfa65778e0: done: 0.024084 sec","job_status":"done","queue_duration_s":2.033032,"scheduling_latency_s":2.033063,"redis_calls":7,"redis_duration_s":0.001753,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001277,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024084,"completed_at":"2026-09-04T07:48:07.106Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2658gitlab # [ 513.744307] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.108Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"55cfbccf32b254d38dafc71c","created_at":"2026-09-04T07:48:05.065Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1928bfaf9bfd8bf231df3ec53f774665","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.069Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-55cfbccf32b254d38dafc71c: start","job_status":"start","queue_duration_s":2.039059,"scheduling_latency_s":2.039085}2659gitlab # [ 513.758682] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"55cfbccf32b254d38dafc71c","created_at":"2026-09-04T07:48:05.065Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1928bfaf9bfd8bf231df3ec53f774665","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.069Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-55cfbccf32b254d38dafc71c: done: 0.109489 sec","job_status":"done","queue_duration_s":2.039059,"scheduling_latency_s":2.039085,"redis_calls":60,"redis_duration_s":0.01061,"redis_read_bytes":109,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000629,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.009474,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000507,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.109489,"completed_at":"2026-09-04T07:48:07.217Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2660gitlab # [ 513.799513] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c3e5fd5b715120de759d081","created_at":"2026-09-04T07:48:05.089Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7f2026b8ca45d163a843d07642925fb","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.094Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c3e5fd5b715120de759d081: start","job_status":"start","queue_duration_s":2.124256,"scheduling_latency_s":2.124281}2661gitlab # [ 513.813609] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c3e5fd5b715120de759d081","created_at":"2026-09-04T07:48:05.089Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7f2026b8ca45d163a843d07642925fb","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.094Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c3e5fd5b715120de759d081: done: 0.019193 sec","job_status":"done","queue_duration_s":2.124256,"scheduling_latency_s":2.124281,"redis_calls":9,"redis_duration_s":0.0015010000000000002,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045766,"exclusive_lock_hold_duration_s":0.00415354,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.019193,"completed_at":"2026-09-04T07:48:07.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2662gitlab # [ 513.854518] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"87aacae480263086b0ce89f4","created_at":"2026-09-04T07:48:05.115Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0b6dc75893ac76e0c3435c5e2534346","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.131Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-87aacae480263086b0ce89f4: start","job_status":"start","queue_duration_s":2.109192,"scheduling_latency_s":2.109219}2663gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0e4246fe7989959ccaa7a0b477e69c5b50b1944a/statuses, in 0.25 seconds)2664(finished: subtest: eval and build post commit statuses, in 10.78 seconds)2665(finished: run the VM test script, in 625.62 seconds)2666gitlab # [ 513.868827] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"87aacae480263086b0ce89f4","created_at":"2026-09-04T07:48:05.115Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0b6dc75893ac76e0c3435c5e2534346","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-04T07:48:05.131Z","job_size_bytes":2,"pid":3909,"sidekiq_tid":"m90t","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-87aacae480263086b0ce89f4: done: 0.024163 sec","job_status":"done","queue_duration_s":2.109192,"scheduling_latency_s":2.109219,"redis_calls":12,"redis_duration_s":0.002945,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000366,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001358,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003802,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.024163,"completed_at":"2026-09-04T07:48:07.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2667test script finished in 625.66s2668cleanup2669kill QemuMachine (pid 46)2670gitlab # [ 513.915372] sidekiq-cluster[3909]: {"severity":"INFO","time":"2026-09-04T07:48:07.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4d626e94e30dd28690125316","created_at":"2026-09-04T07:48:05.150Z","trace_propagation_headers":{"sentry-trace":"e9d98503bbca4186bd1bda9880e92c38-200de35cd6774b54","baggage":"sentry-trace_id=e9d98503bbca4186bd1bda9880e92c38,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d12eb48057c2bf029eb2df20e28677dc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:48:05.155Z","job_qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2671(finished: cleanup, in 2.07 seconds)2672additionally exposed symbols:2673 gitlab,2674 vlan1,2675 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2676[]2677[]2678[]2679[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-04T07:46:11.681Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2680[]2681[]2682[]2683[]2684[]2685[]2686[]2687[]2688[]2689[]2690[]2691[]2692[]2693[]2694[]2695[]2696[]2697[]2698[]2699[]2700[]2701[]2702[]2703[]2704[]2705[]2706[]2707[]2708[]2709[]2710[]2711[]2712[]2713[]2714[]2715[]2716[]2717[]2718[]2719[]2720[]2721[]2722[]2723[]2724[]2725[]2726[]2727[]2728[]2729[]2730[]2731[]2732[]2733[]2734[]2735[]2736[]2737[]2738[]2739[]2740[]2741[]2742[]2743[]2744[]2745[]2746[]2747[]2748[]2749[]2750[]2751[]2752[]2753[]2754[]2755[]2756[]2757[]2758[]2759[]2760[]2761[]2762[]2763[]2764[]2765[]2766[]2767[]2768[]2769[]2770[]2771[]2772[]2773[]2774[]2775[]2776[]2777[]2778[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-04T07:47:56.718205Z', 'started_at': '2026-09-04T07:47:57.336794Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2779[{'id': 5, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:57.263Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2780[{'id': 5, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:57.263Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2781[{'id': 5, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:57.263Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2782[{'id': 5, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:57.263Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2783[{'id': 5, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:57.263Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2784[{'id': 5, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:57.263Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2785[{'id': 5, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:57.263Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2786[{'id': 5, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:57.263Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2787[{'id': 5, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-04T07:47:57.263Z', 'started_at': None, 'finished_at': '2026-09-04T07:48:07.616Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '0e4246fe7989959ccaa7a0b477e69c5b50b1944a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-04T07:48:07.824Z', 'started_at': None, 'finished_at': '2026-09-04T07:48:07.976Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]