vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #208
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.jI2cKVA3Of', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 828d10ea-0c3b-4f66-94b2-1ce97f22104416gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20(finished: start all VMs, in 70.18 seconds)21gitlab # Writing inode tables: 0/8 done22gitlab: waiting for unit setup-gitlab.service23gitlab # Creating journal (8192 blocks): done24gitlab: waiting for the VM to finish booting25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/phj82x9zkjk7528n3gq74lgx715y7d2j-nixos-system-gitlab-test/init regInfo=/nix/store/agl1r5zlk20822cs40xkdg92vxwmbjd1-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/agl1r5zlk20822cs40xkdg92vxwmbjd1-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000400] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000614] Console: colour dummy device 80x25110gitlab # [ 0.000621] printk: legacy console [tty0] enabled111gitlab # [ 0.000815] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000821] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000910] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001044] landlock: Up and running.115gitlab # [ 0.001047] Yama: becoming mindful.116gitlab # [ 0.001486] LSM support for eBPF active117gitlab # [ 0.001675] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001781] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002880] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003539] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003543] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003687] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004694] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004788] EFI services will not be available.125gitlab # [ 0.005002] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005638] Detected PIPT I-cache on CPU1127gitlab # [ 0.005739] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005862] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005985] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007037] Detected PIPT I-cache on CPU2131gitlab # [ 0.007142] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007278] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007401] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008449] Detected PIPT I-cache on CPU3135gitlab # [ 0.008564] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008690] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008817] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009311] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009338] SMP: Total of 4 processors activated.140gitlab # [ 0.009340] CPU: All CPU(s) started at EL1141gitlab # [ 0.009348] CPU features: detected: Branch Target Identification142gitlab # [ 0.009352] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009355] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009358] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009361] CPU features: detected: Common not Private translations146gitlab # [ 0.009364] CPU features: detected: CRC32 instructions147gitlab # [ 0.009366] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009370] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009373] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009375] CPU features: detected: E0PD151gitlab # [ 0.009377] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009380] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009383] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009385] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009388] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009392] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009395] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009397] CPU features: detected: Privileged Access Never159gitlab # [ 0.009399] CPU features: detected: PMUv3160gitlab # [ 0.009402] CPU features: detected: RAS Extension Support161gitlab # [ 0.009404] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009406] CPU features: detected: Random Number Generator163gitlab # [ 0.009409] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009411] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009414] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009417] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009541] alternatives: applying system-wide alternatives168gitlab # [ 0.012411] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012645] Memory: 5963740K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014120] devtmpfs: initialized171gitlab # [ 0.017976] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018039] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018210] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018214] 0 pages in range for non-PLT usage175gitlab # [ 0.018216] 508288 pages in range for PLT usage176gitlab # [ 0.018333] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019113] DMI not present or invalid.178gitlab # [ 0.022257] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024883] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025261] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026980] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027002] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027338] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027804] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027807] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027812] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027814] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027817] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027899] cpuidle: using governor ladder190gitlab # [ 0.027923] cpuidle: using governor menu191gitlab # [ 0.028123] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028342] ASID allocator initialised with 65536 entries193gitlab # [ 0.029392] Serial: AMBA PL011 UART driver194gitlab # [ 0.034417] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034693] printk: console [ttyAMA0] enabled196gitlab # [ 0.043386] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.043405] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.043414] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.043422] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.043431] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.043438] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.043447] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.043454] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.055595] fbcon: Taking over console205gitlab # [ 0.055607] ACPI: Interpreter disabled.206gitlab # [ 0.056639] iommu: Default domain type: Translated207gitlab # [ 0.056655] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.074383] SCSI subsystem initialized209gitlab # [ 0.074750] usbcore: registered new interface driver usbfs210gitlab # [ 0.074773] usbcore: registered new interface driver hub211gitlab # [ 0.074788] usbcore: registered new device driver usb212gitlab # [ 0.075041] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.075045] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.075062] PTP clock support registered215gitlab # [ 0.075100] EDAC MC: Ver: 3.0.0216gitlab # [ 0.075599] scmi_core: SCMI protocol bus registered217gitlab # [ 0.076575] FPGA manager framework218gitlab # [ 0.077381] vgaarb: loaded219gitlab # [ 0.078821] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.088245] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.088311] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.088841] netfs: FS-Cache loaded223gitlab # [ 0.088968] pnp: PnP ACPI: disabled224gitlab # [ 0.095061] NET: Registered PF_INET protocol family225gitlab # [ 0.096030] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.125396] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.125445] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.125486] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.125754] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.126315] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.126403] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.126450] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.126560] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.126756] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.126778] NET: Registered PF_XDP protocol family236gitlab # [ 0.126790] PCI: CLS 0 bytes, default 64237gitlab # [ 0.127159] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.139028] kvm [1]: HYP mode not available239gitlab # [ 0.184719] Initialise system trusted keyrings240gitlab # [ 0.185070] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.185751] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.185881] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.197756] Key type asymmetric registered244gitlab # [ 0.197761] Asymmetric key parser 'x509' registered245gitlab # [ 0.197809] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.198089] io scheduler mq-deadline registered247gitlab # [ 0.198105] io scheduler kyber registered248gitlab # [ 0.211918] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.218993] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.220175] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.220213] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.220259] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.220279] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.220323] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.220373] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.220651] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.220671] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.220682] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.220691] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.220701] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.220958] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.222386] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.223093] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.223131] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.223210] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.223262] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.224801] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.225488] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.225524] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.225617] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.227202] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.227850] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.227886] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.227975] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.229461] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.230094] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.230129] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.230218] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.231885] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.232550] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.232586] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.232678] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.234213] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.234873] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.234922] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.235032] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.236576] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.237237] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.237271] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.237350] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.237386] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.239026] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.239733] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.239823] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.241417] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.242052] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.242133] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.243521] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.244136] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.244933] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.245638] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.245673] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.245763] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.247332] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.247995] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.248032] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.248120] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.249985] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.250003] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.250015] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.250205] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.250359] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.250503] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.250637] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.250775] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.250957] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.251104] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.251239] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.251399] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.251592] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.251745] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.251802] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.251855] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.251910] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.251976] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.252030] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.252084] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.252138] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.252205] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.252259] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.252318] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.252385] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.252439] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.252492] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.252545] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.252609] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.252661] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.252715] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.252778] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.252832] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.252888] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.252953] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.252968] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.252977] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.256998] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.285488] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.289504] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.293843] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.299724] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.303444] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.307263] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.313029] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.317309] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.321681] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.327021] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.331230] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.341827] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.344957] msm_serial: driver initialized359gitlab # [ 0.345213] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.345309] STM32 USART driver initialized361gitlab # [ 0.377556] loop: module loaded362gitlab # [ 0.377877] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.381243] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.384259] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.387200] virtio_blk virtio5: [vdb] 12147272 512-byte logical blocks (6.22 GB/5.79 GiB)366gitlab # [ 0.390490] megasas: 07.734.00.00-rc1367gitlab # [ 0.391726] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.394617] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.394645] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.397218] Using buffer write method371gitlab # [ 0.397310] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.400051] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.400074] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.403075] Using buffer write method375gitlab # [ 0.403114] Concatenating MTD devices:376gitlab # [ 0.403118] (0): "0.flash"377gitlab # [ 0.403121] (1): "0.flash"378gitlab # [ 0.403124] into device "0.flash"379gitlab # [ 0.569673] Freeing initrd memory: 27184K380gitlab # [ 0.587370] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.595921] thunder_xcv, ver 1.0382gitlab # [ 0.596030] thunder_bgx, ver 1.0383gitlab # [ 0.596128] nicpf, ver 1.0384gitlab # [ 0.597811] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.597823] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.597915] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.597930] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.597998] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.598007] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.598090] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.598101] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.598496] sky2: driver version 1.30393gitlab # [ 0.603725] usbcore: registered new interface driver usb-storage394gitlab # [ 0.603833] ehci-pci 0000:00:0a.0: EHCI Host Controller395gitlab # [ 0.603863] usbcore: registered new interface driver usbserial_generic396gitlab # [ 0.603910] usbserial: USB Serial support registered for generic397gitlab # [ 0.603929] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.604524] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.605698] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.608178] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.608235] rtc-pl031 9010000.pl031: setting system clock to 2026-08-12T13:08:12 UTC (1786540092)402gitlab # [ 0.609116] i2c_dev: i2c /dev entries driver403gitlab # [ 0.614922] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.615965] hub 1-0:1.0: USB hub found405gitlab # [ 0.616057] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.617471] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.617485] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.618335] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.619541] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.624064] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.624813] usbcore: registered new interface driver usbhid412gitlab # [ 0.624822] usbhid: USB HID core driver413gitlab # [ 0.660080] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.663972] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.664233] NET: Registered PF_INET6 protocol family416gitlab # [ 0.665805] Segment Routing with IPv6417gitlab # [ 0.665835] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.665891] NET: Registered PF_PACKET protocol family419gitlab # [ 0.666128] 9pnet: Installing 9P2000 support420gitlab # [ 0.669689] Key type dns_resolver registered421gitlab # [ 0.685210] registered taskstats version 1422gitlab # [ 0.685680] Loading compiled-in X.509 certificates423gitlab # [ 0.707144] Demotion targets for Node 0: null424gitlab # [ 0.707440] Key type .fscrypt registered425gitlab # [ 0.707447] Key type fscrypt-provisioning registered426gitlab # [ 0.707629] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.707651] ima: Allocated hash algorithm: sha1428gitlab # [ 0.707679] ima: No architecture policies found429gitlab # [ 0.708899] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.736434] clk: Disabling unused clocks431gitlab # [ 0.736463] PM: genpd: Disabling unused power domains432gitlab # [ 0.741733] Freeing unused kernel memory: 4736K433gitlab # [ 0.741951] Run /init as init process434gitlab # [ 0.773288] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.862909] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.015673] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.103722] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.107798] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.107846] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.107913] systemd[1]: Detected architecture arm64.441gitlab # [ 1.107927] systemd[1]: Running in initrd.442gitlab # [ 1.108781] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.109040] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.222919] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.337344] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.383292] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.383757] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.419823] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.437800] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.438052] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.438087] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.438102] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.438126] systemd[1]: Reached target Path Units.454gitlab # [ 1.438143] systemd[1]: Reached target Slice Units.455gitlab # [ 1.438163] systemd[1]: Reached target Swaps.456gitlab # [ 1.438183] systemd[1]: Reached target Timer Units.457gitlab # [ 1.438359] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.438529] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.438686] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.438939] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.439041] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.439064] systemd[1]: Reached target Socket Units.463gitlab # [ 1.440928] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.442803] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.442900] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.444635] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.470269] systemd[1]: Starting Journal Service...468gitlab # [ 1.473530] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.473627] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.475086] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.476825] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.482294] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.482677] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.485947] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.494964] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.515956] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0477gitlab # [ 1.516235] [drm] features: -virgl +edid -resource_blob -host_visible478gitlab # [ 1.516256] [drm] features: -context_init479gitlab # [ 1.523098] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.480gitlab # [ 1.524296] [drm] number of scanouts: 1481gitlab # [ 1.524315] [drm] number of cap sets: 0482gitlab # [ 1.526169] systemd-journald[95]: Collecting audit messages is disabled.483gitlab # [ 1.526826] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.484gitlab # [ 1.527046] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev485gitlab # [ 1.527579] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic486gitlab # [ 1.527588] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0487gitlab # [ 1.528319] systemd[1]: Starting Create Static Device Nodes in /dev...488gitlab # [ 1.539147] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.547656] systemd[1]: Finished Create Static Device Nodes in /dev.490gitlab # [ 1.547799] systemd[1]: Reached target Preparation for Local File Systems.491gitlab # [ 1.547814] systemd[1]: Reached target Local File Systems.492gitlab # [ 1.552063] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device493gitlab # [ 1.552074] systemd[1]: Starting Rule-based Manager for Device Events and Files...494gitlab # [ 1.576712] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.578182] systemd[1]: Starting Apply Kernel Variables...496gitlab # [ 1.591716] systemd[1]: Finished Apply Kernel Variables.497gitlab # [ 1.606234] systemd[1]: Started Journal Service.498gitlab # [ 1.603711] systemd-modules-load[96]: Using 4 probe threads499gitlab # [ 1.606817] systemd-modules-load[96]: Module 'virtio_balloon' is built in500gitlab # [ 1.608056] systemd-modules-load[96]: Module 'virtio_console' is built in501gitlab # [ 1.609270] systemd-modules-load[96]: Module 'virtio_rng' is built in502gitlab # [ 1.610415] systemd-modules-load[96]: Inserted module 'dm_mod'503gitlab # [ 1.611429] systemd-modules-load[96]: Inserted module 'virtio_gpu'504gitlab # [ 1.612894] systemd-udevd[105]: Using default interface naming scheme 'v261'.505gitlab # [ 1.614468] systemd[1]: Starting Create System Files and Directories...506gitlab # [ 1.617618] systemd[1]: Finished Create System Files and Directories.507gitlab # [ 1.632676] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.653062] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.706696] systemd-vconsole-setup[129]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.710087] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.111556] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.113254] systemd[1]: Reached target System Initialization.513gitlab # [ 2.114104] systemd[1]: Reached target Basic System.514gitlab # [ 2.283718] (udev-worker)[146]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.290287] (udev-worker)[146]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.297381] (udev-worker)[141]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.333140] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.335305] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.337163] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.364147] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.383252] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.389119] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.476255] systemd[1]: Mounting /sysroot...524gitlab # [ 2.520779] EXT4-fs (vda): mounted filesystem 828d10ea-0c3b-4f66-94b2-1ce97f221044 r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.522032] systemd[1]: Mounted /sysroot.526gitlab # [ 2.523100] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.525181] systemd[1]: Starting Mountpoints Configured in the Real Root...528gitlab # [ 2.545727] systemd-sysroot-fstab-check[160]: /sysroot should be mounted in the initrd, will request daemon-reload.529gitlab # [ 2.549905] systemd[1]: Reload requested from client PID 160 ('systemd-sysroot') (unit initrd-parse-etc.service)...530gitlab # [ 2.551731] systemd[1]: Reloading...531gitlab # [ 2.651141] systemd[1]: Reloading finished in 102 ms.532gitlab # [ 2.710961] systemd-sysroot-fstab-check[160]: Requesting initrd-fs.target/start/replace...533gitlab # [ 2.712862] systemd-sysroot-fstab-check[160]: Requesting swap.target/start/replace...534gitlab # [ 2.715340] systemd[1]: initrd-parse-etc.service: Deactivated successfully.535gitlab # [ 2.716646] systemd[1]: Finished Mountpoints Configured in the Real Root.536gitlab # [ 2.719878] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.537gitlab # [ 2.722168] systemd[1]: Starting Load Kernel Module 9pnet_virtio...538gitlab # [ 2.738607] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.539gitlab # [ 2.740059] systemd[1]: Finished Load Kernel Module 9pnet_virtio.540gitlab # [ 2.854897] (udev-worker)[119]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory541gitlab # [ 2.859053] (udev-worker)[119]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory542gitlab # [ 2.866160] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.543gitlab # [ 2.867299] systemd[1]: Stopped Virtual Console Setup.544gitlab # [ 2.868105] systemd[1]: Stopping Virtual Console Setup...545gitlab # [ 2.868885] systemd[1]: Starting Virtual Console Setup...546gitlab # [ 2.897546] systemd-vconsole-setup[182]: Configuration of first virtual console was skipped, ignoring remaining ones.547gitlab # [ 2.899493] systemd[1]: Finished Virtual Console Setup.548gitlab # [ 3.480825] systemd[1]: Mounting /sysroot/nix/.ro-store...549gitlab # [ 3.484401] systemd[1]: Mounting /sysroot/nix/.rw-store...550gitlab # [ 3.488189] systemd[1]: Mounting /sysroot/run...551gitlab # [ 3.509051] systemd[1]: Mounting /sysroot/tmp/shared...552gitlab # [ 3.521704] systemd[1]: Mounting /sysroot/tmp/xchg...553gitlab # [ 3.527574] systemd[1]: Mounted /sysroot/nix/.rw-store.554gitlab # [ 3.535511] systemd[1]: Mounted /sysroot/run.555gitlab # [ 3.544532] systemd[1]: Starting rw-sysroot-nix-store.service...556gitlab # [ 3.554194] erofs (device vdb): mounted with root inode @ nid 128.557gitlab # [ 3.559821] systemd[1]: Mounted /sysroot/nix/.ro-store.558gitlab # [ 3.563001] systemd[1]: Mounted /sysroot/tmp/shared.559gitlab # [ 3.564814] systemd[1]: Mounted /sysroot/tmp/xchg.560gitlab # [ 3.567723] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.561gitlab # [ 3.570272] systemd[1]: Finished rw-sysroot-nix-store.service.562gitlab # [ 4.478559] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 4.551029] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 4.553512] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 4.555912] systemd[1]: Starting Find NixOS closure...566gitlab # [ 4.558349] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 4.603439] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 4.607212] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 4.623199] systemd[1]: Finished Find NixOS closure.570gitlab # [ 4.625594] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 4.628098] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 4.683577] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 4.686269] systemd[1]: Stopped target Basic System.574gitlab # [ 4.688517] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 4.690868] systemd[1]: Stopped target Path Units.576gitlab # [ 4.693043] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 4.696243] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 4.699541] systemd[1]: Stopped target Slice Units.579gitlab # [ 4.701817] systemd[1]: Stopped target Socket Units.580gitlab # [ 4.703960] systemd[1]: Stopped target System Initialization.581gitlab # [ 4.709403] systemd[1]: Stopped target Swaps.582gitlab # [ 4.711346] systemd[1]: Stopped target Timer Units.583gitlab # [ 4.717853] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 4.720433] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 4.722778] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 4.726161] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 4.728502] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 4.730991] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 4.733997] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 4.736515] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 4.738557] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 4.741319] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 4.743213] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 4.746167] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 4.749112] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 4.751759] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 4.754037] systemd[1]: Stopped target Local File Systems.598gitlab # [ 4.755864] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 4.758245] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 4.760628] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 4.762314] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 4.764635] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 4.766680] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 4.768225] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 4.770026] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 4.771752] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.607gitlab # [ 4.773729] systemd[1]: Finished Load Kernel Module 9pnet_virtio.608gitlab # [ 4.775265] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 4.777121] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 4.778517] systemd[1]: systemd-udevd.service: Deactivated successfully.611gitlab # [ 4.780090] systemd[1]: Stopped Rule-based Manager for Device Events and Files.612gitlab # [ 4.781735] systemd[1]: systemd-udevd.service: Consumed 2.191s CPU time over 3.201s wall clock time, 31.9M memory peak.613gitlab # [ 4.783976] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 4.785520] systemd[1]: Closed udev Control Socket.615gitlab # [ 4.786594] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 4.787748] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 4.789417] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 4.790673] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 4.792333] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 4.793897] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 4.795244] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 4.877542] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 4.880848] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 4.883115] systemd[1]: Reached target Switch Root.625gitlab # [ 4.885385] systemd[1]: Starting NixOS Activation...626gitlab # [ 5.059097] initrd-nixos-activation-start[221]: booting system configuration /nix/store/phj82x9zkjk7528n3gq74lgx715y7d2j-nixos-system-gitlab-test627gitlab # [ 5.122124] initrd-nixos-activation-start[221]: running activation script...628gitlab # [ 5.489804] initrd-nixos-activation-start[244]: setting up /etc...629gitlab # [ 5.630197] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 5.633794] systemd[1]: Finished NixOS Activation.631gitlab # [ 5.635913] systemd[1]: Starting Switch Root...632gitlab # [ 5.687018] systemd[1]: Switching root.633gitlab # [ 5.831234] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 6.499769] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 6.499915] systemd[1]: Detected virtualization qemu.636gitlab # [ 6.499996] systemd[1]: Detected architecture arm64.637gitlab # [ 6.500176] systemd[1]: Detected first boot.638gitlab # [ 6.501531] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 6.732113] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 6.851412] systemd[1]: Applying preset policy.641gitlab # [ 7.020363] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 7.161992] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 7.162397] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 7.166669] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 7.174129] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 7.177970] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 7.182144] systemd[1]: Created slice User and Session Slice.648gitlab # [ 7.183609] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 7.184976] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 7.186144] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 7.187360] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 7.188475] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 7.189596] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 7.190680] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 7.191852] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 7.192951] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 7.194093] systemd[1]: Reached target Path Units.658gitlab # [ 7.195247] systemd[1]: Reached target Remote File Systems.659gitlab # [ 7.196330] systemd[1]: Reached target Slice Units.660gitlab # [ 7.197417] systemd[1]: Reached target Swaps.661gitlab # [ 7.201408] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 7.205637] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 7.208830] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 7.212488] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 7.213809] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 7.224170] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 7.226154] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 7.229910] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 7.231364] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 7.232380] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 7.233273] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 7.238777] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 7.240006] systemd[1]: Listening on udev Control Socket.674gitlab # [ 7.241219] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 7.284246] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 7.289448] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 7.295805] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 7.316954] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 7.323584] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 7.329286] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 7.330425] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 7.343138] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 7.344375] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 7.345480] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 7.367063] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 7.368119] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 7.382459] systemd[1]: Starting Journal Service...688gitlab # [ 7.386390] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 7.395017] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 7.403580] systemd[1]: Starting Remount Root and Kernel File Systems...691gitlab # [ 7.404317] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os692gitlab # [ 7.405384] fuse: init (API version 7.45)693gitlab # [ 7.416056] systemd[1]: Starting Coldplug All udev Devices...694gitlab # [ 7.429840] systemd[1]: Listening on Journal Log Access Socket.695gitlab # [ 7.433189] systemd[1]: Mounted Huge Pages File System.696gitlab # [ 7.436172] systemd[1]: Mounted POSIX Message Queue File System.697gitlab # [ 7.440080] systemd[1]: Mounted Kernel Debug File System.698gitlab # [ 7.441929] systemd[1]: Mounted Kernel Trace File System.699gitlab # [ 7.443076] systemd[1]: Finished Create List of Static Device Nodes.700gitlab # [ 7.444120] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.701gitlab # [ 7.444980] systemd[1]: Finished Load Kernel Module 9pnet_virtio.702gitlab # [ 7.445711] systemd[1]: Mounted Kernel Configuration File System.703gitlab # [ 7.448671] systemd[1]: modprobe@fuse.service: Deactivated successfully.704gitlab # [ 7.450086] systemd-journald[315]: Collecting audit messages is enabled.705gitlab # [ 7.451713] systemd[1]: Finished Load Kernel Module fuse.706gitlab # [ 7.452601] systemd[1]: Finished Load Kernel Modules.707gitlab # [ 7.458574] EXT4-fs (vda): re-mounted 828d10ea-0c3b-4f66-94b2-1ce97f221044.708gitlab # [ 7.467099] systemd[1]: Mounting FUSE Control File System...709gitlab # [ 7.466728] systemd[1]: Queued start job for default target Multi-User System.710gitlab # [ 7.468710] systemd[1]: Unnecessary job was removed for /dev/vdb.711gitlab # [ 7.469846] systemd[1]: systemd-journald.service: Deactivated successfully.712gitlab # [ 7.471117] systemd-modules-load[316]: Using 3 probe threads713gitlab # [ 7.472141] systemd-modules-load[316]: Module 'atkbd' is built in714gitlab # [ 7.473200] systemd-modules-load[316]: Module 'loop' is built in715gitlab # [ 7.474213] systemd-modules-load[316]: Inserted module 'tls'716gitlab # [ 7.475470] systemd-oomd[317]: No swap; memory pressure usage will be degraded717gitlab # [ 7.508949] systemd[1]: Starting Firewall...718gitlab # [ 7.519077] systemd[1]: Starting Apply Kernel Variables...719gitlab # [ 7.531052] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...720gitlab # [ 7.534014] systemd[1]: Started Journal Service.721gitlab # [ 7.536809] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.722gitlab # [ 7.544094] systemd[1]: Finished Remount Root and Kernel File Systems.723gitlab # [ 7.547524] systemd[1]: Mounted FUSE Control File System.724gitlab # [ 7.562931] systemd[1]: Listening on Disk Image Download Service Socket.725gitlab # [ 7.568330] systemd[1]: Starting Flush Journal to Persistent Storage...726gitlab # [ 7.575936] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore727gitlab # [ 7.579482] systemd[1]: Starting Load/Save OS Random Seed...728gitlab # [ 7.582239] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os729gitlab # [ 7.600711] systemd[1]: Finished Apply Kernel Variables.730gitlab # [ 7.606629] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.731gitlab # [ 7.613146] systemd-journald[315]: Received client request to flush runtime journal.732gitlab # [ 7.648835] systemd[1]: Starting Create Static Device Nodes in /dev...733gitlab # [ 7.650598] systemd[1]: Finished Load/Save OS Random Seed.734gitlab # [ 7.652776] systemd[1]: Reached target First Boot Complete.735gitlab # [ 7.654469] systemd[1]: Finished Create Static Device Nodes in /dev.736gitlab # [ 7.655775] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 7.657545] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 7.659035] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 7.700818] systemd-udevd[359]: Using default interface naming scheme 'v261'.740gitlab # [ 7.736817] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 7.992232] systemd[1]: Finished Firewall.742gitlab # [ 8.064417] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 8.148764] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs744gitlab # [ 8.161760] systemd[1]: Mounting /run/wrappers...745gitlab # [ 8.228557] (udev-worker)[400]: Network interface NamePolicy= disabled on kernel command line.746gitlab # [ 8.230983] systemd[1]: Mounted /run/wrappers.747gitlab # [ 8.240170] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.748gitlab # [ 8.248349] systemd[1]: Reached target Local File Systems.749gitlab # [ 8.250285] systemd[1]: Listening on Boot Loader Control Service Socket.750gitlab # [ 8.255206] systemd[1]: Starting register-nix-paths.service...751gitlab # [ 8.259960] (udev-worker)[463]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.752gitlab # [ 8.268277] (udev-worker)[463]: Network interface NamePolicy= disabled on kernel command line.753gitlab # [ 8.270356] systemd[1]: Starting Create SUID/SGID Wrappers...754gitlab # [ 8.271977] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.755gitlab # [ 8.278471] systemd[1]: Starting Save Transient machine-id to Disk...756gitlab # [ 8.284095] systemd[1]: Starting Create System Files and Directories...757gitlab # [ 8.285572] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.758gitlab # [ 8.301791] systemd[1]: Condition check resulted in Virtio network device being skipped.759gitlab # [ 8.304126] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore760gitlab # [ 8.308807] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.761gitlab # [ 8.316298] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67762gitlab # [ 8.322270] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore763gitlab # [ 8.324707] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os764gitlab # [ 8.327841] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os765gitlab # [ 8.329571] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.766gitlab # [ 8.330732] systemd[1]: Finished Save Transient machine-id to Disk.767gitlab # [ 8.344685] systemd[1]: Finished Create System Files and Directories.768gitlab # [ 8.349655] systemd[1]: Starting Rebuild Journal Catalog...769gitlab # [ 8.352617] systemd[1]: Starting Record System Boot/Shutdown in UTMP...770gitlab # [ 8.386272] mousedev: PS/2 mouse device common for all mice771gitlab # [ 8.386434] systemd[1]: Finished Record System Boot/Shutdown in UTMP.772gitlab # [ 8.400598] systemd[1]: Finished Rebuild Journal Catalog.773gitlab # [ 8.404673] systemd[1]: Starting Update is Completed...774gitlab # [ 8.445065] systemd[1]: Finished Update is Completed.775gitlab # [ 8.471451] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.776gitlab # [ 8.472791] systemd[1]: Finished Create SUID/SGID Wrappers.777gitlab # [ 8.473805] systemd[1]: suid-sgid-wrappers.service: Consumed 136ms CPU time over 206ms wall clock time, 6.1M memory peak, 1.9M read from disk.778gitlab # [ 8.735002] systemd[1]: Finished register-nix-paths.service.779gitlab # [ 8.735985] systemd[1]: Reached target System Initialization.780gitlab # [ 8.736910] systemd[1]: Started Discard unused filesystem blocks once a week.781gitlab # [ 8.737917] systemd[1]: Started logrotate.timer.782gitlab # [ 8.738603] systemd[1]: Started Daily Cleanup of Temporary Directories.783gitlab # [ 8.739524] systemd[1]: Reached target Timer Units.784gitlab # [ 8.740886] systemd[1]: Listening on D-Bus System Message Bus Socket.785gitlab # [ 8.741878] systemd[1]: Listening on Nix Daemon Socket.786gitlab # [ 8.749433] systemd[1]: Starting nixbot CI service socket...787gitlab # [ 8.750427] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.788gitlab # [ 8.751612] systemd[1]: Listening on nixbot CI service socket.789gitlab # [ 8.752536] systemd[1]: Reached target Socket Units.790gitlab # [ 8.754237] systemd[1]: Starting D-Bus System Message Bus...791gitlab # [ 8.794921] dbus-broker-launch[558]: Looking up NSS user entry for 'systemd-timesync'...792gitlab # [ 8.796701] dbus-broker-launch[558]: NSS returned no entry for 'systemd-timesync'793gitlab # [ 8.798072] dbus-broker-launch[558]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"794gitlab # [ 8.800576] systemd[1]: Started D-Bus System Message Bus.795gitlab # [ 8.811116] dbus-broker-launch[558]: Ready796gitlab # [ 8.812516] systemd[1]: Reached target Basic System.797gitlab # [ 8.844108] systemd[1]: Started backdoor.service.798gitlab # [ 8.856659] systemd[1]: Starting gitlab-config.service...799gitlab # connecting to host...800gitlab: Guest shell says: b'Spawning backdoor root shell...\n'801gitlab # [ 8.903493] systemd[1]: Starting Import lastlog data into lastlog2 database...802gitlab: connected to guest root shell803gitlab: (connecting took 9.35 seconds)804gitlab: (finished: waiting for the VM to finish booting, in 9.35 seconds)805gitlab # [ 8.929564] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3806gitlab # [ 8.933053] systemd[1]: Starting Logrotate configuration check...807gitlab # [ 8.948738] systemd[1]: Starting Name Service Cache Daemon (nsncd)...808gitlab # [ 8.951698] logrotate[575]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.809gitlab # [ 8.953986] logrotate[575]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf810gitlab # [ 8.955238] logrotate[575]: note: 'monthly' overrides previously specified 'weekly'811gitlab # [ 8.956310] logrotate[575]: Reading state from file: /var/lib/logrotate.status812gitlab # [ 8.957259] logrotate[575]: state file /var/lib/logrotate.status does not exist813gitlab # [ 8.958386] logrotate[575]: Allocating hash table for state file, size 64 entries814gitlab # [ 8.959350] logrotate[575]: Handling 4 logs815gitlab # [ 8.959921] logrotate[575]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed816gitlab # [ 8.962230] logrotate[575]: considering log /var/log/btmp817gitlab # [ 8.963037] logrotate[575]: Creating new state818gitlab # [ 8.963643] logrotate[575]: Now: 2026-08-12 13:08819gitlab # [ 8.964492] logrotate[575]: Last rotated at 2026-08-12 13:00820gitlab # [ 8.965320] logrotate[575]: log does not need rotating (log has already been rotated)821gitlab # [ 8.966506] logrotate[575]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed822gitlab # [ 8.968689] logrotate[575]: considering log /var/log/wtmp823gitlab # [ 8.969409] logrotate[575]: Creating new state824gitlab # [ 8.970008] logrotate[575]: Now: 2026-08-12 13:08825gitlab # [ 8.970761] logrotate[575]: Last rotated at 2026-08-12 13:00826gitlab # [ 8.971538] logrotate[575]: log does not need rotating (log has already been rotated)827gitlab # [ 8.972648] logrotate[575]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed828gitlab # [ 8.974572] logrotate[575]: switching euid from 0 to 165 and egid from 0 to 165 (pid 575)829gitlab # [ 8.975710] logrotate[575]: considering log /var/gitlab/state/log/*.log830gitlab # [ 8.976698] logrotate[575]: log /var/gitlab/state/log/*.log does not exist -- skipping831gitlab # [ 8.978210] logrotate[575]: Creating new state832gitlab # [ 8.978899] logrotate[575]: switching euid from 165 to 0 and egid from 165 to 0 (pid 575)833gitlab # [ 8.979997] logrotate[575]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed834gitlab # [ 8.981708] logrotate[575]: switching euid from 0 to 60 and egid from 0 to 60 (pid 575)835gitlab # [ 8.982772] logrotate[575]: considering log /var/log/nginx/*.log836gitlab # [ 8.983595] logrotate[575]: log /var/log/nginx/*.log does not exist -- skipping837gitlab # [ 8.984629] logrotate[575]: Creating new state838gitlab # [ 8.985230] logrotate[575]: not running postrotate script, since no logs were rotated839gitlab # [ 8.986829] logrotate[575]: switching euid from 60 to 0 and egid from 60 to 0 (pid 575)840gitlab # [ 8.987965] systemd[1]: Starting Post-Boot Actions...841gitlab # [ 8.988907] systemd[1]: Started Reset console on configuration changes.842gitlab # [ 8.992277] nsncd[578]: Aug 12 13:08:20.882 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"843gitlab # [ 8.994445] systemd[1]: Starting resolvconf update...844gitlab # [ 8.995281] systemd[1]: Finished Logrotate configuration check.845gitlab # [ 8.997339] systemd[1]: Finished Post-Boot Actions.846gitlab # [ 8.998178] systemd[1]: Started Name Service Cache Daemon (nsncd).847gitlab # [ 8.999009] systemd[1]: Finished Import lastlog data into lastlog2 database.848gitlab # [ 9.027550] systemd[1]: Reached target Host and Network Name Lookups.849gitlab # [ 9.028597] systemd[1]: Reached target User and Group Name Lookups.850gitlab # [ 9.045889] systemd[1]: Starting User Login Management...851gitlab # [ 9.048221] systemd[1]: Starting Virtual Console Setup...852gitlab # [ 9.062290] systemd[1]: Stopped target Host and Network Name Lookups.853gitlab # [ 9.063909] systemd[1]: Stopping Host and Network Name Lookups...854gitlab # [ 9.065049] systemd[1]: Stopped target User and Group Name Lookups.855gitlab # [ 9.066322] systemd[1]: Stopping User and Group Name Lookups...856gitlab # [ 9.067684] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...857gitlab # [ 9.069259] systemd[1]: nscd.service: Deactivated successfully.858gitlab # [ 9.070156] systemd[1]: Stopped Name Service Cache Daemon (nsncd).859gitlab # [ 9.070990] systemd[1]: nscd.service: Consumed 29ms CPU time over 119ms wall clock time, 7.5M memory peak, 5.8M read from disk.860gitlab # [ 9.078590] systemd[1]: Starting Name Service Cache Daemon (nsncd)...861gitlab # [ 9.096663] systemd-logind[634]: New seat seat0.862gitlab # [ 9.101209] systemd-logind[634]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)863gitlab # [ 9.102719] systemd-logind[634]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)864gitlab # [ 9.105126] systemd-logind[634]: Watching system buttons on /dev/input/event0 (gpio-keys)865gitlab # [ 9.106601] nsncd[661]: Aug 12 13:08:20.997 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"866gitlab # [ 9.111762] systemd[1]: Started Name Service Cache Daemon (nsncd).867gitlab # [ 9.112776] systemd[1]: Reached target Host and Network Name Lookups.868gitlab # [ 9.113673] systemd[1]: Reached target User and Group Name Lookups.869gitlab # [ 9.114649] systemd[1]: Started User Login Management.870gitlab # [ 9.115377] systemd[1]: Starting linger-users.service...871gitlab # [ 9.120217] systemd-vconsole-setup[639]: Configuration of first virtual console was skipped, ignoring remaining ones.872gitlab # [ 9.132599] systemd[1]: Finished Virtual Console Setup.873gitlab # [ 9.137154] systemd[1]: Finished resolvconf update.874gitlab # [ 9.137898] systemd[1]: Reached target Preparation for Network.875gitlab # [ 9.141152] systemd[1]: Starting DHCP Client...876gitlab # [ 9.144634] systemd[1]: Starting Address configuration of eth1...877gitlab # [ 9.148451] systemd[1]: Starting Extra networking commands....878gitlab # [ 9.151313] systemd[1]: linger-users.service: Deactivated successfully.879gitlab # [ 9.154149] systemd[1]: Finished linger-users.service.880gitlab # [ 9.175399] network-addresses-eth1-start[689]: adding address 192.168.1.1/24... done881gitlab # [ 9.180498] network-addresses-eth1-start[689]: adding address 2001:db8:1::1/64... done882gitlab # [ 9.187516] systemd[1]: Finished Address configuration of eth1.883gitlab # [ 9.231836] systemd[1]: Finished Extra networking commands..884gitlab # [ 9.232943] systemd[1]: Reached target Network.885gitlab # [ 9.236190] systemd[1]: Starting gitlab-workhorse.service...886gitlab # [ 9.238644] systemd[1]: Starting Nginx Web Server...887gitlab # [ 9.241625] systemd[1]: Starting PostgreSQL Server...888gitlab # [ 9.243903] dhcpcd[705]: dhcpcd-10.3.2 starting889gitlab # [ 9.248095] dhcpcd[758]: dev: loaded udev890gitlab # [ 9.248792] systemd[1]: Starting Redis Server - redis-gitlab...891gitlab # [ 9.252580] systemd[1]: Starting Permit User Sessions...892gitlab # [ 9.267418] 8021q: 802.1Q VLAN Support v1.8893gitlab # [ 9.267818] 8021q: adding VLAN 0 to HW filter on device eth1894gitlab # [ 9.284132] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.895gitlab # [ 9.305152] systemd[1]: Finished Permit User Sessions.896gitlab # [ 9.310315] systemd[1]: Started Getty on tty1.897gitlab # [ 9.311029] systemd[1]: Reached target Login Prompts.898gitlab # [ 9.319374] cfg80211: Loading compiled-in X.509 certificates for regulatory database899gitlab # [ 9.324794] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'900gitlab # [ 9.325296] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'901gitlab # [ 9.327853] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2902gitlab # [ 9.328191] cfg80211: failed to load regulatory.db903gitlab # [ 9.369831] 8021q: adding VLAN 0 to HW filter on device eth0904gitlab # [ 9.367921] dhcpcd[758]: eth0: waiting for carrier905gitlab # [ 9.371086] dhcpcd[758]: eth0: carrier acquired906gitlab # [ 9.376647] dhcpcd[758]: DUID 00:01:00:01:32:0f:2c:c5:52:54:00:12:34:56907gitlab # [ 9.377782] dhcpcd[758]: eth0: IAID 00:12:34:56908gitlab # [ 9.378544] dhcpcd[758]: eth0: adding address fe80::5054:ff:fe12:3456909gitlab # [ 9.412952] nginx-pre-start[786]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok910gitlab # [ 9.414977] nginx-pre-start[786]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful911gitlab # [ 9.418351] systemd[1]: Started Nginx Web Server.912gitlab # [ 9.460397] redis-server[783]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.913gitlab # [ 9.462866] redis-server[783]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo914gitlab # [ 9.464601] postgresql-pre-start[789]: The files belonging to this database system will be owned by user "postgres".915gitlab # [ 9.466187] postgresql-pre-start[789]: This user must also own the server process.916gitlab # [ 9.467275] redis-server[783]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=783, just started917gitlab # [ 9.469061] systemd[1]: Started Redis Server - redis-gitlab.918gitlab # [ 9.470008] postgresql-pre-start[789]: The database cluster will be initialized with locale "en_US.UTF-8".919gitlab # [ 9.471361] postgresql-pre-start[789]: The default database encoding has accordingly been set to "UTF8".920gitlab # [ 9.472789] postgresql-pre-start[789]: The default text search configuration will be set to "english".921gitlab # [ 9.474146] postgresql-pre-start[789]: Data page checksums are enabled.922gitlab # [ 9.475180] postgresql-pre-start[789]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok923gitlab # [ 9.476641] postgresql-pre-start[789]: creating subdirectories ... ok924gitlab # [ 9.477547] postgresql-pre-start[789]: selecting dynamic shared memory implementation ... posix925gitlab # [ 9.478816] redis-server[783]: Configuration loaded926gitlab # [ 9.479715] redis[783]: monotonic clock: ARM CNTVCT @ 1000 ticks/us927gitlab # [ 9.480806] redis[783]: Running mode=standalone, port=0.928gitlab # [ 9.481699] redis[783]: Server initialized929gitlab # [ 9.482414] redis[783]: Ready to accept connections unix930gitlab # [ 9.483263] redis[783]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.931gitlab # [ 9.511048] postgresql-pre-start[789]: selecting default "max_connections" ... 100932gitlab # [ 9.558423] postgresql-pre-start[789]: selecting default "shared_buffers" ... 128MB933gitlab # [ 9.849052] systemd[1]: Started gitlab-workhorse.service.934gitlab # [ 10.013586] postgresql-pre-start[789]: selecting default time zone ... UTC935gitlab # [ 10.017654] postgresql-pre-start[789]: creating configuration files ... ok936gitlab # [ 10.072254] gitlab-workhorse[816]: time="2026-08-12T13:08:21Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4937gitlab # [ 10.073989] gitlab-workhorse[816]: time="2026-08-12T13:08:21Z" level=info msg="Using redis/go-redis"938gitlab # [ 10.075217] gitlab-workhorse[816]: time="2026-08-12T13:08:21Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix939gitlab # [ 10.252322] postgresql-pre-start[789]: running bootstrap script ... ok940gitlab # [ 10.650422] dhcpcd[758]: eth0: soliciting an IPv6 router941gitlab # [ 10.653324] dhcpcd[758]: eth0: Router Advertisement from fe80::2942gitlab # [ 10.655953] dhcpcd[758]: eth0: adding address fec0::5054:ff:fe12:3456/64943gitlab # [ 10.659210] dhcpcd[758]: eth0: adding route to fec0::/64944gitlab # [ 10.661698] dhcpcd[758]: eth0: adding default route via fe80::2945gitlab # [ 10.707307] dhcpcd[758]: eth0: soliciting a DHCP lease946gitlab # [ 10.728962] dhcpcd[758]: eth0: offered 10.0.2.15 from 10.0.2.2947gitlab # [ 10.748558] dhcpcd[758]: eth0: probing address 10.0.2.15/24948gitlab # [ 11.002532] postgresql-pre-start[789]: performing post-bootstrap initialization ... ok949gitlab # [ 11.280721] postgresql-pre-start[789]: syncing data to disk ... ok950gitlab # [ 11.283422] postgresql-pre-start[789]: initdb: warning: enabling "trust" authentication for local connections951gitlab # [ 11.287539] postgresql-pre-start[789]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.952gitlab # [ 11.294214] postgresql-pre-start[789]: Success. You can now start the database server using:953gitlab # [ 11.297771] postgresql-pre-start[789]: pg_ctl -D /var/lib/postgresql/18 -l logfile start954gitlab # [ 11.466093] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit955gitlab # [ 11.471835] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 5432956gitlab # [ 11.475359] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 5432957gitlab # [ 11.478967] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"958gitlab # [ 11.485897] postgres[859]: [859] LOG: database system was shut down at 2026-08-12 13:08:22 GMT959gitlab # [ 11.494419] postgres[850]: [850] LOG: database system is ready to accept connections960gitlab # [ 11.499507] systemd[1]: Started PostgreSQL Server.961gitlab # [ 11.508660] systemd[1]: Starting PostgreSQL Setup Scripts...962gitlab # [ 11.787786] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[868]: mkdir -p /var/gitlab/state/home/.ssh: OK963gitlab # [ 11.791924] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[868]: chmod 700 /var/gitlab/state/home/.ssh: OK964gitlab # [ 11.872927] postgresql-setup-start[874]: CREATE DATABASE965gitlab # [ 11.887491] systemd[1]: Finished gitlab-config.service.966gitlab # [ 11.895276] systemd[1]: Started gitaly.service.967gitlab # [ 11.922253] postgresql-setup-start[893]: CREATE ROLE968gitlab # [ 11.951158] postgresql-setup-start[896]: ALTER DATABASE969gitlab # [ 12.006492] postgresql-setup-start[901]: CREATE ROLE970gitlab # [ 12.009663] systemd[1]: Finished PostgreSQL Setup Scripts.971gitlab # [ 12.012853] systemd[1]: Reached target PostgreSQL.972gitlab # [ 12.017386] systemd[1]: Starting gitlab-db-config.service...973gitlab # [ 12.024215] systemd[1]: Starting gitlab-postgresql.service...974gitlab # [ 12.243050] gitlab-postgresql-start[911]: CREATE DATABASE975gitlab # [ 12.310417] gitlab-postgresql-start[934]: CREATE EXTENSION976gitlab # [ 12.407644] gitlab-postgresql-start[939]: CREATE EXTENSION977gitlab # [ 12.412070] systemd[1]: Finished gitlab-postgresql.service.978gitlab # [ 12.623887] gitaly[892]: time="2026-08-12T13:08:24.517Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=892979gitlab # [ 12.634929] gitaly[892]: time="2026-08-12T13:08:24.517Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=892980gitlab # [ 12.639836] gitaly[892]: time="2026-08-12T13:08:24.517Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=892981gitlab # [ 12.646096] gitaly[892]: time="2026-08-12T13:08:24.517Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=892982gitlab # [ 12.651493] gitaly[892]: time="2026-08-12T13:08:24.517Z" level=info msg="Starting Gitaly" pid=892 version=983gitlab # [ 12.835194] gitaly[892]: time="2026-08-12T13:08:24.729Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=211 pid=892984gitlab # [ 12.837197] gitaly[892]: time="2026-08-12T13:08:24.729Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=892985gitlab # [ 12.838800] gitaly[892]: time="2026-08-12T13:08:24.730Z" level=info msg="finished initializing command factory" duration_ms=0 pid=892986gitlab # [ 12.840792] gitaly[892]: time="2026-08-12T13:08:24.730Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-892/git-exec-1437902299.d/git pid=892987gitlab # [ 12.843380] gitaly[892]: time="2026-08-12T13:08:24.736Z" level=info msg="finished detecting git version" duration_ms=6 pid=892988gitlab # [ 12.845709] gitaly[892]: time="2026-08-12T13:08:24.736Z" level=info msg="using Git version" pid=892 version=2.53.g989gitlab # [ 12.847772] gitaly[892]: time="2026-08-12T13:08:24.736Z" level=info msg="clearing disk cache object folder" pid=892 storage=default990gitlab # [ 12.850248] gitaly[892]: time="2026-08-12T13:08:24.737Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3402607039 pid=892 storage=default991gitlab # [ 12.854559] gitaly[892]: time="2026-08-12T13:08:24.737Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3402607039 pid=892 storage=default992gitlab # [ 12.859554] gitaly[892]: time="2026-08-12T13:08:24.737Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=892993gitlab # [ 12.864535] gitaly[892]: time="2026-08-12T13:08:24.737Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=892994gitlab # [ 12.869317] gitaly[892]: time="2026-08-12T13:08:24.737Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3402607039 clear_duration_ms=0 pid=892 storage=default995gitlab # [ 12.874073] gitaly[892]: time="2026-08-12T13:08:24.764Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=892996gitlab # [ 12.877952] gitaly[892]: time="2026-08-12T13:08:24.764Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=892 schema=unix997gitlab # [ 12.881701] gitaly[892]: time="2026-08-12T13:08:24.765Z" level=info msg="listening at address" address=/run/gitaly/gitaly-892/sock.d/intern pid=892 schema=unix998gitlab # [ 12.885100] gitaly[892]: time="2026-08-12T13:08:24.765Z" level=info msg="finished tempdir cleaner walk" pid=892 storage=default time_ms=0999gitlab # [ 12.888327] gitaly[892]: time="2026-08-12T13:08:24.765Z" level=info msg="counting repositories" pid=8921000gitlab # [ 12.890625] gitaly[892]: time="2026-08-12T13:08:24.765Z" level=info msg="starting to count repositories" pid=892 storage_path=/var/gitlab/state/repositories1001gitlab # [ 12.894581] gitaly[892]: time="2026-08-12T13:08:24.765Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=892 storage_path=/var/gitlab/state/repositories1002gitlab # [ 12.898818] gitaly[892]: time="2026-08-12T13:08:24.765Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8921003gitlab # [ 12.902051] gitaly[892]: time="2026-08-12T13:08:24.766Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8921004gitlab # [ 12.905177] gitaly[892]: time="2026-08-12T13:08:24.766Z" level=info msg="Started Gitaly" duration_ms=249 pid=8921005gitlab # [ 12.907707] gitaly[892]: time="2026-08-12T13:08:24.767Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8921006gitlab # [ 12.910784] gitaly[892]: time="2026-08-12T13:08:24.767Z" level=info msg="maintenance: daily scheduled" pid=892 scheduled="2026-08-13 12:00:00 +0000 UTC"1007gitlab # [ 13.253415] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[906]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1008gitlab # [ 13.257575] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[906]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1009gitlab # [ 13.275553] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[906]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1010gitlab # [ 15.405459] dhcpcd[758]: eth0: leased 10.0.2.15 for 86400 seconds1011gitlab # [ 15.405785] dhcpcd[758]: eth0: adding route to 10.0.2.0/241012gitlab # [ 15.405920] dhcpcd[758]: eth0: adding default route via 10.0.2.21013gitlab # [ 15.596439] systemd[1]: Started DHCP Client.1014gitlab # [ 15.598239] systemd[1]: Reached target Network is Online.1015gitlab # [ 16.351226] gitaly[892]: time="2026-08-12T13:08:28.244Z" level=info msg="License database preloaded" duration_ms=3727 pid=8921016gitlab # [ 55.844105] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[906]: W, [2026-08-12T13:09:07.737971 #906] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1017gitlab # [ 59.007294] postgres[1415]: [1415] ERROR: relation "feature_gates" does not exist at character 5231018gitlab # [ 59.008488] postgres[1415]: [1415] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1019gitlab # [ 59.012251] postgres[1415]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1020gitlab # [ 59.016123] postgres[1415]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1021gitlab # [ 59.019603] postgres[1415]: attidentity AS identity,1022gitlab # [ 59.022041] postgres[1415]: attgenerated as attgenerated1023gitlab # [ 59.024515] postgres[1415]: FROM pg_attribute a1024gitlab # [ 59.026520] postgres[1415]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1025gitlab # [ 59.030310] postgres[1415]: LEFT JOIN pg_type t ON a.atttypid = t.oid1026gitlab # [ 59.033175] postgres[1415]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1027gitlab # [ 59.037427] postgres[1415]: WHERE a.attrelid = '"feature_gates"'::regclass1028gitlab # [ 59.040301] postgres[1415]: AND a.attnum > 0 AND NOT a.attisdropped1029gitlab # [ 59.042930] postgres[1415]: ORDER BY a.attnum1030gitlab # [ 59.044947] postgres[1415]:1031gitlab # [ 60.183149] gitlab-workhorse[816]: time="2026-08-12T13:09:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1032gitlab # [ 64.240462] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1466]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1033gitlab # [ 64.240879] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1466]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1034gitlab # [ 70.190661] gitlab-workhorse[816]: time="2026-08-12T13:09:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 80.194858] gitlab-workhorse[816]: time="2026-08-12T13:09:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 90.099950] postgres[1560]: [1560] ERROR: relation "table_without_models" does not exist1037gitlab # [ 90.100599] postgres[1560]: [1560] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1038gitlab # [ 90.201845] gitlab-workhorse[816]: time="2026-08-12T13:09:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 100.203359] gitlab-workhorse[816]: time="2026-08-12T13:09:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 110.210338] gitlab-workhorse[816]: time="2026-08-12T13:10:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 120.218131] gitlab-workhorse[816]: time="2026-08-12T13:10:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 120.346541] systemd[1]: Finished gitlab-db-config.service.1043gitlab # [ 120.353112] systemd[1]: Started gitlab-sidekiq.service.1044gitlab # [ 120.358344] systemd[1]: Starting gitlab.service...1045gitlab # [ 120.914763] bundle[1944]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1046gitlab # [ 120.921269] bundle[1944]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1047gitlab # [ 120.927133] bundle[1944]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1048gitlab # [ 125.434189] sidekiq-cluster[1943]: {"severity":"INFO","time":"2026-08-12T13:10:17.299Z","message":"Starting cluster with 1 processes"}1049gitlab # [ 125.449293] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.315Z","pid":1944,"message":"* Enabling systemd notification integration"}1050gitlab # [ 125.454230] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.342Z","pid":1944,"message":"Puma starting in cluster mode..."}1051gitlab # [ 125.458685] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.342Z","pid":1944,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1052gitlab # [ 125.463435] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.343Z","pid":1944,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1053gitlab # [ 125.469377] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.343Z","pid":1944,"message":"* Min threads: 0"}1054gitlab # [ 125.473224] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.343Z","pid":1944,"message":"* Max threads: 4"}1055gitlab # [ 125.477257] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.343Z","pid":1944,"message":"* Environment: production"}1056gitlab # [ 125.481973] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.343Z","pid":1944,"message":"* Master PID: 1944"}1057gitlab # [ 125.486033] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.343Z","pid":1944,"message":"* Workers: 2"}1058gitlab # [ 125.489943] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.343Z","pid":1944,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1059gitlab # [ 125.494943] bundle[1944]: {"timestamp":"2026-08-12T13:10:17.343Z","pid":1944,"message":"* Preloading application"}1060gitlab # [ 130.220759] gitlab-workhorse[816]: time="2026-08-12T13:10:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 140.222445] gitlab-workhorse[816]: time="2026-08-12T13:10:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 150.230644] gitlab-workhorse[816]: time="2026-08-12T13:10:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 160.235268] gitlab-workhorse[816]: time="2026-08-12T13:10:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 162.452482] bundle[1944]: W, [2026-08-12T13:10:54.343037 #1944] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1065gitlab # [ 166.585988] sidekiq-cluster[1984]: 2026-08-12T13:10:58.479Z pid=1984 tid=wo8 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1984, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431742976}1066gitlab # [ 166.868579] sidekiq-cluster[1984]: W, [2026-08-12T13:10:58.762945 #1984] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1067gitlab # [ 166.936351] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:10:58.830Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1068gitlab # [ 170.236455] gitlab-workhorse[816]: time="2026-08-12T13:11:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1069gitlab # [ 170.808934] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.702Z","message":"GitLab reliable fetch activated!"}1070gitlab # [ 170.813938] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.702Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1071gitlab # [ 170.855694] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.749Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1072gitlab # [ 170.863115] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.756Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1073gitlab # [ 170.870367] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.762Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1074gitlab # [ 170.877082] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.768Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1075gitlab # [ 170.884456] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.775Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1076gitlab # [ 170.891164] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.781Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1077gitlab # [ 170.898183] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.785Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1078gitlab # [ 170.904057] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.789Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1079gitlab # [ 170.909447] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.792Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1080gitlab # [ 170.914466] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.796Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1081gitlab # [ 170.919688] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.799Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1082gitlab # [ 170.924339] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.804Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1083gitlab # [ 170.928110] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.807Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1084gitlab # [ 170.931937] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.810Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1085gitlab # [ 170.935781] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.814Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1086gitlab # [ 170.939504] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.817Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1087gitlab # [ 170.942860] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.821Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1088gitlab # [ 170.945948] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.825Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1089gitlab # [ 170.949156] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.829Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1090gitlab # [ 170.952060] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.832Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1091gitlab # [ 170.955171] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.836Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1092gitlab # [ 170.958508] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.839Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1093gitlab # [ 170.961289] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.841Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1094gitlab # [ 170.963958] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.844Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1095gitlab # [ 170.966854] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.847Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1096gitlab # [ 170.969458] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.850Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1097gitlab # [ 170.971783] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.853Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1098gitlab # [ 170.974339] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.857Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1099gitlab # [ 170.976751] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.860Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1100gitlab # [ 170.979049] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.863Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1101gitlab # [ 170.981326] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.866Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1102gitlab # [ 170.983675] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.869Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1103gitlab # [ 170.985930] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.872Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1104gitlab # [ 170.988205] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.875Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1105gitlab # [ 170.990370] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.877Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1106gitlab # [ 170.992548] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.879Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1107gitlab # [ 170.994663] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.881Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1108gitlab # [ 170.996780] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.884Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1109gitlab # [ 170.998841] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.886Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1110gitlab # [ 171.000957] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.888Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1111gitlab # [ 171.003115] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.890Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1112gitlab # [ 171.005346] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.892Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1113gitlab # [ 171.007516] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.894Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1114gitlab # [ 171.009733] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.896Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1115gitlab # [ 171.011901] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.899Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1116gitlab # [ 171.014347] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.901Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1117gitlab # [ 171.016533] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.902Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1118gitlab # [ 171.018645] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.905Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1119gitlab # [ 171.020798] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.907Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1120gitlab # [ 171.022882] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.910Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1121gitlab # [ 171.025095] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.912Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1122gitlab # [ 171.027148] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.915Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1123gitlab # [ 171.034243] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.928Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1124gitlab # [ 171.037301] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.931Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1125gitlab # [ 171.039685] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.934Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1126gitlab # [ 171.042230] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.936Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1127gitlab # [ 171.044885] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.939Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1128gitlab # [ 171.047911] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.942Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1129gitlab # [ 171.050330] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.944Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1130gitlab # [ 171.052623] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.946Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1131gitlab # [ 171.054641] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.948Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1132gitlab # [ 171.056736] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.950Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1133gitlab # [ 171.058901] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.952Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1134gitlab # [ 171.061203] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.955Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1135gitlab # [ 171.063419] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.957Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1136gitlab # [ 171.065745] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.960Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1137gitlab # [ 171.067797] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.962Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1138gitlab # [ 171.070148] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.963Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1139gitlab # [ 171.072485] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.965Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1140gitlab # [ 171.074770] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.967Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1141gitlab # [ 171.077114] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.968Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1142gitlab # [ 171.079310] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.970Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1143gitlab # [ 171.081664] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.972Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1144gitlab # [ 171.084000] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.974Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1145gitlab # [ 171.086321] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.976Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1146gitlab # [ 171.088789] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.978Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1147gitlab # [ 171.090983] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.980Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1148gitlab # [ 171.093576] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.982Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1149gitlab # [ 171.098228] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.990Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1150gitlab # [ 171.102519] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:02.996Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1151gitlab # [ 171.107162] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.001Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1152gitlab # [ 171.111888] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.006Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1153gitlab # [ 171.119485] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.013Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1154gitlab # [ 171.123119] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.017Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1155gitlab # [ 171.127484] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.021Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1156gitlab # [ 171.130542] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.024Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1157gitlab # [ 171.134192] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.028Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1158gitlab # [ 171.137043] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.031Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1159gitlab # [ 171.139617] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.034Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1160gitlab # [ 171.142142] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.036Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1161gitlab # [ 171.144531] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.038Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1162gitlab # [ 171.146763] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.041Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1163gitlab # [ 171.149156] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.043Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1164gitlab # [ 171.151568] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.045Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1165gitlab # [ 171.154559] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.049Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1166gitlab # [ 171.157967] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.052Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1167gitlab # [ 171.160243] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.054Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1168gitlab # [ 171.162422] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.056Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1169gitlab # [ 171.177168] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.071Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1170gitlab # [ 171.179464] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.073Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1171gitlab # [ 171.181833] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.075Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1172gitlab # [ 171.184900] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.079Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1173gitlab # [ 171.187879] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.082Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1174gitlab # [ 171.190390] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.084Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1175gitlab # [ 171.238543] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.133Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1176gitlab # [ 171.242398] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.135Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1177gitlab # [ 171.245830] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.137Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1178gitlab # [ 171.249438] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.142Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1179gitlab # [ 171.253923] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:03.144Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1180gitlab # [ 180.237566] gitlab-workhorse[816]: time="2026-08-12T13:11:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 190.248677] gitlab-workhorse[816]: time="2026-08-12T13:11:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 200.258544] gitlab-workhorse[816]: time="2026-08-12T13:11:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 210.179997] postgres[2704]: [2704] ERROR: relation "table_without_models" does not exist1184gitlab # [ 210.182770] postgres[2704]: [2704] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1185gitlab # [ 210.266237] gitlab-workhorse[816]: time="2026-08-12T13:11:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 213.007424] postgres[2724]: [2724] ERROR: relation "table_without_models" does not exist1187gitlab # [ 213.011117] postgres[2724]: [2724] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1188gitlab # [ 215.054874] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:46.948Z","message":"Booted Rails 7.2.3.1 application in production environment"}1189gitlab # [ 215.057778] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:46.951Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1190gitlab # [ 215.059783] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:46.951Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1191gitlab # [ 215.068204] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:46.951Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1192gitlab # [ 215.070251] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:46.957Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1193gitlab # [ 217.800915] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:49.693Z","message":"Cleaning working queues"}1194gitlab # [ 217.805847] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:49.699Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"244acc2078bbc020ab0c1d8c","created_at":"2026-08-12T13:10:11.408Z","trace_propagation_headers":{"sentry-trace":"945bb72e88ea40bcbcd7b23eb5537c1e-2479ac819c7e4b71","baggage":"sentry-trace_id=945bb72e88ea40bcbcd7b23eb5537c1e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"34203a1393ddca8bb44af01c16710824","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-12T13:10:11.419Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-244acc2078bbc020ab0c1d8c: start","job_status":"start","queue_duration_s":98.279815,"scheduling_latency_s":98.27992}1195gitlab # [ 218.178109] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:11:50.071Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"244acc2078bbc020ab0c1d8c","created_at":"2026-08-12T13:10:11.408Z","trace_propagation_headers":{"sentry-trace":"945bb72e88ea40bcbcd7b23eb5537c1e-2479ac819c7e4b71","baggage":"sentry-trace_id=945bb72e88ea40bcbcd7b23eb5537c1e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"34203a1393ddca8bb44af01c16710824","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-12T13:10:11.419Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-244acc2078bbc020ab0c1d8c: done: 0.372494 sec","job_status":"done","queue_duration_s":98.279815,"scheduling_latency_s":98.27992,"redis_calls":29,"redis_duration_s":0.012768,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007749,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003041,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001978,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.188966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19527422,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.372494,"completed_at":"2026-08-12T13:11:50.071Z","load_balancing_strategy":"primary","db_duration_s":0.106931,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1196gitlab # [ 220.110080] bundle[1944]: {"timestamp":"2026-08-12T13:11:52.003Z","pid":1944,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1197gitlab # [ 220.110434] bundle[1944]: {"timestamp":"2026-08-12T13:11:52.003Z","pid":1944,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1198gitlab # [ 220.110640] bundle[1944]: {"timestamp":"2026-08-12T13:11:52.003Z","pid":1944,"message":"! #\u003cThread:0x0000fdfd0006a738 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1199gitlab # [ 220.110754] bundle[1944]: {"timestamp":"2026-08-12T13:11:52.003Z","pid":1944,"message":"! #\u003cThread:0x0000fdfcff94d5e0 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1200gitlab # [ 220.110870] bundle[1944]: {"timestamp":"2026-08-12T13:11:52.003Z","pid":1944,"message":"Use Ctrl-C to stop"}1201gitlab # [ 220.110989] bundle[1944]: {"timestamp":"2026-08-12T13:11:52.004Z","pid":1944,"message":"Sending status to systemd every 1.0 sec"}1202gitlab # [ 220.817602] bundle[1944]: {"timestamp":"2026-08-12T13:11:52.711Z","pid":1944,"message":"- Worker 0 (PID: 2851) booted in 0.67s, phase: 0"}1203gitlab # [ 220.875941] bundle[1944]: {"timestamp":"2026-08-12T13:11:52.770Z","pid":1944,"message":"- Worker 1 (PID: 2855) booted in 0.71s, phase: 0"}1204gitlab # [ 220.885114] systemd[1]: Started gitlab.service.1205gitlab # [ 220.887217] systemd[1]: Reached target Common target for all GitLab services..1206gitlab # [ 220.890167] systemd[1]: Starting setup-gitlab.service...1207gitlab # [ 220.926596] setup-gitlab-start[2882]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1208gitlab # [ 224.676563] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:11:56 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 37131209gitlab # [ 224.681170] setup-gitlab-start[2882]: + TOKEN=nixbot-test-token-of-20-chars1210gitlab # [ 224.682050] setup-gitlab-start[2882]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1211gitlab # [ 224.698353] runuser[2909]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1212gitlab # [ 225.274242] setup-gitlab-start[2910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1213gitlab # [ 225.280994] setup-gitlab-start[2910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1214gitlab # [ 225.287222] setup-gitlab-start[2910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1215gitlab # [ 226.108250] setup-gitlab-start[2910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1216gitlab # [ 226.108580] setup-gitlab-start[2910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1217gitlab # [ 226.111095] setup-gitlab-start[2910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1218gitlab # [ 231.904333] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:03.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"014463e56b204f40690575da","created_at":"2026-08-12T13:12:03.687Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"077607d504413308d61e3ac6f44cd139","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:03.793Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-014463e56b204f40690575da: start","job_status":"start","queue_duration_s":0.003251,"scheduling_latency_s":0.003309}1219gitlab # [ 232.087339] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:03.981Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1220gitlab # [ 232.139686] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:04.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"014463e56b204f40690575da","created_at":"2026-08-12T13:12:03.687Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"077607d504413308d61e3ac6f44cd139","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:03.793Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-014463e56b204f40690575da: done: 0.235984 sec","job_status":"done","queue_duration_s":0.003251,"scheduling_latency_s":0.003309,"redis_calls":10,"redis_duration_s":0.025114,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003878,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007578,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0018558,"duration_s":0.235984,"completed_at":"2026-08-12T13:12:04.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023231,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1221gitlab # [ 232.222655] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:04.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b1938a3671e7d7ae759ebd27","created_at":"2026-08-12T13:12:03.839Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adc17a733484ab1b9b7fd4977abdb460","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:03.866Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b1938a3671e7d7ae759ebd27: start","job_status":"start","queue_duration_s":0.231294,"scheduling_latency_s":0.231354}1222gitlab # [ 232.271236] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:04.165Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1223gitlab # [ 232.301131] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:04.194Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b1938a3671e7d7ae759ebd27","created_at":"2026-08-12T13:12:03.839Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adc17a733484ab1b9b7fd4977abdb460","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:03.866Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b1938a3671e7d7ae759ebd27: done: 0.096848 sec","job_status":"done","queue_duration_s":0.231294,"scheduling_latency_s":0.231354,"redis_calls":10,"redis_duration_s":0.028227000000000002,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.024982,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002451,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065292,"duration_s":0.096848,"completed_at":"2026-08-12T13:12:04.194Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 232.380649] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:04.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"99e75b2bfdb1168839e577f0","created_at":"2026-08-12T13:12:03.927Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b05a6b6c33adce0eb0e6bd23c56f8503","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:03.949Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-99e75b2bfdb1168839e577f0: start","job_status":"start","queue_duration_s":0.251285,"scheduling_latency_s":0.251342}1225gitlab # [ 232.514805] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:04.408Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"99e75b2bfdb1168839e577f0","created_at":"2026-08-12T13:12:03.927Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b05a6b6c33adce0eb0e6bd23c56f8503","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:03.949Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-99e75b2bfdb1168839e577f0: done: 0.20734 sec","job_status":"done","queue_duration_s":0.251285,"scheduling_latency_s":0.251342,"redis_calls":12,"redis_duration_s":0.021692,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.008683,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002582,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0016585,"duration_s":0.20734,"completed_at":"2026-08-12T13:12:04.407Z","load_balancing_strategy":"primary","db_duration_s":0.007643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 232.609085] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:04.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"75525cac3d0e1007ed7567a7","created_at":"2026-08-12T13:12:03.964Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c743e614b331c64f611bffdfa561cf8d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:03.998Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-75525cac3d0e1007ed7567a7: start","job_status":"start","queue_duration_s":0.41676,"scheduling_latency_s":0.416802}1227gitlab # [ 233.247418] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:05.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"75525cac3d0e1007ed7567a7","created_at":"2026-08-12T13:12:03.964Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c743e614b331c64f611bffdfa561cf8d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:03.998Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-75525cac3d0e1007ed7567a7: done: 0.724126 sec","job_status":"done","queue_duration_s":0.41676,"scheduling_latency_s":0.416802,"redis_calls":12,"redis_duration_s":0.028338,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003744,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.013253,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.114,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.114,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.137529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00155236,"exclusive_lock_hold_duration_s":0.5464161,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.724126,"completed_at":"2026-08-12T13:12:05.138Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.177935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 233.343198] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:05.236Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8c5adb747d729cce1c3be841","created_at":"2026-08-12T13:12:04.019Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d527c4dddc76fe96ddb1e0b8f62a9146","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.038Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8c5adb747d729cce1c3be841: start","job_status":"start","queue_duration_s":1.198119,"scheduling_latency_s":1.198186}1229gitlab # [ 233.721373] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:05.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8c5adb747d729cce1c3be841","created_at":"2026-08-12T13:12:04.019Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d527c4dddc76fe96ddb1e0b8f62a9146","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.038Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8c5adb747d729cce1c3be841: done: 0.377385 sec","job_status":"done","queue_duration_s":1.198119,"scheduling_latency_s":1.198186,"redis_calls":12,"redis_duration_s":0.059442,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006691,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.034593,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00402532,"exclusive_lock_hold_duration_s":0.026240760000000002,"duration_s":0.377385,"completed_at":"2026-08-12T13:12:05.614Z","load_balancing_strategy":"primary","db_duration_s":0.026005,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 233.817688] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:05.619Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a9acc0096d3d6319b11e6a1e","created_at":"2026-08-12T13:12:04.046Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5dd75c47fdf344c452e2970b997b175c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.058Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a9acc0096d3d6319b11e6a1e: start","job_status":"start","queue_duration_s":1.5613,"scheduling_latency_s":1.56135}1231gitlab # [ 234.733144] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:06.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a9acc0096d3d6319b11e6a1e","created_at":"2026-08-12T13:12:04.046Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5dd75c47fdf344c452e2970b997b175c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.058Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a9acc0096d3d6319b11e6a1e: done: 1.005376 sec","job_status":"done","queue_duration_s":1.5613,"scheduling_latency_s":1.56135,"redis_calls":14,"redis_duration_s":0.019164,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004381,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007797,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.201,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.201,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.532765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00139614,"exclusive_lock_hold_duration_s":0.89926978,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":1.005376,"completed_at":"2026-08-12T13:12:06.624Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.445089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 234.792229] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:06.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"340c9b97da30a290da4249b0","created_at":"2026-08-12T13:12:04.074Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd4731d785c1197cc2e94825d820ddb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.083Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-340c9b97da30a290da4249b0: start","job_status":"start","queue_duration_s":2.555068,"scheduling_latency_s":2.555125}1233gitlab # [ 234.917633] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:06.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"340c9b97da30a290da4249b0","created_at":"2026-08-12T13:12:04.074Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd4731d785c1197cc2e94825d820ddb9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.083Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-340c9b97da30a290da4249b0: done: 0.171503 sec","job_status":"done","queue_duration_s":2.555068,"scheduling_latency_s":2.555125,"redis_calls":12,"redis_duration_s":0.034467,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00434,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.014753,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.062,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0018459,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.171503,"completed_at":"2026-08-12T13:12:06.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.061666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 235.030976] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:06.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"935c973d19b593d801f2acd1","created_at":"2026-08-12T13:12:04.091Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e90d33db3c854717a2406532ba059a8f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.106Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-935c973d19b593d801f2acd1: start","job_status":"start","queue_duration_s":2.720055,"scheduling_latency_s":2.72016}1235gitlab # [ 235.100158] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:06.994Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1236gitlab # [ 235.151745] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:07.044Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"935c973d19b593d801f2acd1","created_at":"2026-08-12T13:12:04.091Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e90d33db3c854717a2406532ba059a8f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.106Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-935c973d19b593d801f2acd1: done: 0.218338 sec","job_status":"done","queue_duration_s":2.720055,"scheduling_latency_s":2.72016,"redis_calls":10,"redis_duration_s":0.1311,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.110828,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013951,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006321,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00284584,"duration_s":0.218338,"completed_at":"2026-08-12T13:12:07.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 235.226951] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:07.057Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1260de0d998320af739b84e0","created_at":"2026-08-12T13:12:04.166Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.204Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1260de0d998320af739b84e0: start","job_status":"start","queue_duration_s":2.852925,"scheduling_latency_s":2.852977}1238gitlab # [ 235.859258] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:07.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1260de0d998320af739b84e0","created_at":"2026-08-12T13:12:04.166Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.204Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1260de0d998320af739b84e0: done: 0.693997 sec","job_status":"done","queue_duration_s":2.852925,"scheduling_latency_s":2.852977,"redis_calls":71,"redis_duration_s":0.21907400000000002,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.024777,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.003965,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.180408,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.009924,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.28766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003823,"duration_s":0.693997,"completed_at":"2026-08-12T13:12:07.751Z","load_balancing_strategy":"primary","db_duration_s":0.024488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 235.951548] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:07.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"4fbe172c722661e26fa62f80","created_at":"2026-08-12T13:12:04.247Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0e53a69a8ad96c28000ee6ae74eb56d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.257Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-4fbe172c722661e26fa62f80: start","job_status":"start","queue_duration_s":3.510519,"scheduling_latency_s":3.510582}1240gitlab # [ 236.043973] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:07.937Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"4fbe172c722661e26fa62f80","created_at":"2026-08-12T13:12:04.247Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0e53a69a8ad96c28000ee6ae74eb56d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.257Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-4fbe172c722661e26fa62f80: done: 0.169301 sec","job_status":"done","queue_duration_s":3.510519,"scheduling_latency_s":3.510582,"redis_calls":12,"redis_duration_s":0.032534999999999994,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003608,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.012006,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00467916,"exclusive_lock_hold_duration_s":0.05985202,"duration_s":0.169301,"completed_at":"2026-08-12T13:12:07.937Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.057743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 236.148826] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:07.954Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b02bab1194893b75c2bef9e2","created_at":"2026-08-12T13:12:04.265Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"748a211a1f4ca245116394fd6278694d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.275Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b02bab1194893b75c2bef9e2: start","job_status":"start","queue_duration_s":3.679532,"scheduling_latency_s":3.679645}1242gitlab # [ 236.208502] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b02bab1194893b75c2bef9e2","created_at":"2026-08-12T13:12:04.265Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"748a211a1f4ca245116394fd6278694d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.275Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b02bab1194893b75c2bef9e2: done: 0.14743 sec","job_status":"done","queue_duration_s":3.679532,"scheduling_latency_s":3.679645,"redis_calls":12,"redis_duration_s":0.029402,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005028,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00224518,"duration_s":0.14743,"completed_at":"2026-08-12T13:12:08.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014135,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 236.279753] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"80ca842c1099fee86b35edd4","created_at":"2026-08-12T13:12:04.314Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c2d581570ffde6500400b85b1aecd6f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.336Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-80ca842c1099fee86b35edd4: start","job_status":"start","queue_duration_s":3.783238,"scheduling_latency_s":3.783302}1244gitlab # [ 236.371369] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"80ca842c1099fee86b35edd4","created_at":"2026-08-12T13:12:04.314Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c2d581570ffde6500400b85b1aecd6f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.336Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-80ca842c1099fee86b35edd4: done: 0.145164 sec","job_status":"done","queue_duration_s":3.783238,"scheduling_latency_s":3.783302,"redis_calls":12,"redis_duration_s":0.022476,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009408,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010058,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00192084,"exclusive_lock_hold_duration_s":0.0087302,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.145164,"completed_at":"2026-08-12T13:12:08.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 236.434705] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b7d18d253c438cd8df12448b","created_at":"2026-08-12T13:12:04.402Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a15acb90d332f07dd54b644bdbcc2277","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.434Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b7d18d253c438cd8df12448b: start","job_status":"start","queue_duration_s":3.843564,"scheduling_latency_s":3.843622}1246gitlab # [ 236.513437] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.407Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b7d18d253c438cd8df12448b","created_at":"2026-08-12T13:12:04.402Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a15acb90d332f07dd54b644bdbcc2277","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.434Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b7d18d253c438cd8df12448b: done: 0.129009 sec","job_status":"done","queue_duration_s":3.843564,"scheduling_latency_s":3.843622,"redis_calls":10,"redis_duration_s":0.028663,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006584,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004378,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00361362,"duration_s":0.129009,"completed_at":"2026-08-12T13:12:08.406Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 236.599212] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.412Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"101fc110c39bf69fe1433a15","created_at":"2026-08-12T13:12:04.444Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c81ef17a0b545cc4455811cf617eb26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-12T13:12:04.455Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-101fc110c39bf69fe1433a15: start","job_status":"start","queue_duration_s":3.957008,"scheduling_latency_s":3.957059}1248gitlab # [ 236.615014] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.451Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1249gitlab # [ 236.619167] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.476Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"101fc110c39bf69fe1433a15","created_at":"2026-08-12T13:12:04.444Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c81ef17a0b545cc4455811cf617eb26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-12T13:12:04.455Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-101fc110c39bf69fe1433a15: done: 0.063875 sec","job_status":"done","queue_duration_s":3.957008,"scheduling_latency_s":3.957059,"redis_calls":10,"redis_duration_s":0.002835,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00055,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000622,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005085,"duration_s":0.063875,"completed_at":"2026-08-12T13:12:08.476Z","load_balancing_strategy":"primary","db_duration_s":0.006746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 236.660752] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d78c2a13c5a37eb24921f5c2","created_at":"2026-08-12T13:12:04.469Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.489Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d78c2a13c5a37eb24921f5c2: start","job_status":"start","queue_duration_s":3.992008,"scheduling_latency_s":3.992056}1251gitlab # [ 236.818873] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d78c2a13c5a37eb24921f5c2","created_at":"2026-08-12T13:12:04.469Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.489Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d78c2a13c5a37eb24921f5c2: done: 0.23018 sec","job_status":"done","queue_duration_s":3.992008,"scheduling_latency_s":3.992056,"redis_calls":19,"redis_duration_s":0.054183999999999996,"redis_read_bytes":22,"redis_write_bytes":4781,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010246,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.002614,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.033911,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.007413,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00380238,"duration_s":0.23018,"completed_at":"2026-08-12T13:12:08.711Z","load_balancing_strategy":"primary","db_duration_s":0.02307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 237.011168] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:08.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"446ba056cc1dbfbc4a7fee1b","created_at":"2026-08-12T13:12:04.509Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"203ff66b314d4b9b24e9e5a000fee5e0","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.540Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-446ba056cc1dbfbc4a7fee1b: start","job_status":"start","queue_duration_s":4.363233,"scheduling_latency_s":4.363294}1253gitlab # [ 237.218085] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.111Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"446ba056cc1dbfbc4a7fee1b","created_at":"2026-08-12T13:12:04.509Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"203ff66b314d4b9b24e9e5a000fee5e0","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.540Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-446ba056cc1dbfbc4a7fee1b: done: 0.207643 sec","job_status":"done","queue_duration_s":4.363233,"scheduling_latency_s":4.363294,"redis_calls":10,"redis_duration_s":0.025275000000000002,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002808,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003781,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0049009,"duration_s":0.207643,"completed_at":"2026-08-12T13:12:09.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 237.299528] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.117Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"24ec4a7f5a17cee60f4303e7","created_at":"2026-08-12T13:12:04.610Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"7e403620bd2c986e6f1e1615056e4dbe","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.620Z","job_size_bytes":3,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-24ec4a7f5a17cee60f4303e7: start","job_status":"start","queue_duration_s":4.497456,"scheduling_latency_s":4.49751}1255gitlab # [ 237.316907] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.183Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"24ec4a7f5a17cee60f4303e7","created_at":"2026-08-12T13:12:04.610Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"7e403620bd2c986e6f1e1615056e4dbe","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.620Z","job_size_bytes":3,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-24ec4a7f5a17cee60f4303e7: done: 0.066094 sec","job_status":"done","queue_duration_s":4.497456,"scheduling_latency_s":4.49751,"redis_calls":10,"redis_duration_s":0.003614,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001047,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001874,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000693,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054666,"duration_s":0.066094,"completed_at":"2026-08-12T13:12:09.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 237.362848] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.189Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0f40865e2951a6a8270a8818","created_at":"2026-08-12T13:12:04.634Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cff24148c39b0c569b98120322ef3e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.644Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0f40865e2951a6a8270a8818: start","job_status":"start","queue_duration_s":4.545678,"scheduling_latency_s":4.545733}1257gitlab # [ 237.454653] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.348Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0f40865e2951a6a8270a8818","created_at":"2026-08-12T13:12:04.634Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cff24148c39b0c569b98120322ef3e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.644Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0f40865e2951a6a8270a8818: done: 0.158667 sec","job_status":"done","queue_duration_s":4.545678,"scheduling_latency_s":4.545733,"redis_calls":16,"redis_duration_s":0.025797,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.012331,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008455,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005011,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001542,"duration_s":0.158667,"completed_at":"2026-08-12T13:12:09.348Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.06248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 237.514850] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4dbcd3e8dbdaf267375f3584","created_at":"2026-08-12T13:12:04.659Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"668789ab101dbf3163d822ea809c5767","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-12T13:12:04.739Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4dbcd3e8dbdaf267375f3584: start","job_status":"start","queue_duration_s":4.623872,"scheduling_latency_s":4.623936}1259gitlab # [ 237.565571] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.459Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1260gitlab # [ 237.596416] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4dbcd3e8dbdaf267375f3584","created_at":"2026-08-12T13:12:04.659Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"668789ab101dbf3163d822ea809c5767","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-12T13:12:04.739Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4dbcd3e8dbdaf267375f3584: done: 0.126557 sec","job_status":"done","queue_duration_s":4.623872,"scheduling_latency_s":4.623936,"redis_calls":10,"redis_duration_s":0.017538,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00201,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003356,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00261388,"duration_s":0.126557,"completed_at":"2026-08-12T13:12:09.490Z","load_balancing_strategy":"primary","db_duration_s":0.005876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1261gitlab # [ 237.698820] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ffc79c3a201a224e2caddd5d","created_at":"2026-08-12T13:12:04.764Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79e711c039de823e7a06dd73dc8261b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-12T13:12:04.803Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ffc79c3a201a224e2caddd5d: start","job_status":"start","queue_duration_s":4.788827,"scheduling_latency_s":4.788885}1262gitlab # [ 237.906801] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:09.800Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ffc79c3a201a224e2caddd5d","created_at":"2026-08-12T13:12:04.764Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79e711c039de823e7a06dd73dc8261b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-12T13:12:04.803Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ffc79c3a201a224e2caddd5d: done: 0.208063 sec","job_status":"done","queue_duration_s":4.788827,"scheduling_latency_s":4.788885,"redis_calls":10,"redis_duration_s":0.022735,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003711,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009861,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00191456,"duration_s":0.208063,"completed_at":"2026-08-12T13:12:09.800Z","load_balancing_strategy":"primary","db_duration_s":0.043297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 238.116912] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:10.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5aa836f8e160595ceb40360a","created_at":"2026-08-12T13:12:04.839Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57dcbcfc7a47ba372e1517865d565314","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.892Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5aa836f8e160595ceb40360a: start","job_status":"start","queue_duration_s":5.116743,"scheduling_latency_s":5.116808}1264gitlab # [ 238.371581] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:10.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5aa836f8e160595ceb40360a","created_at":"2026-08-12T13:12:04.839Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57dcbcfc7a47ba372e1517865d565314","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.892Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5aa836f8e160595ceb40360a: done: 0.25761 sec","job_status":"done","queue_duration_s":5.116743,"scheduling_latency_s":5.116808,"redis_calls":14,"redis_duration_s":0.034958,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.012619,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008606,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.041,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00382572,"exclusive_lock_hold_duration_s":0.09451368,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.25761,"completed_at":"2026-08-12T13:12:10.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.064394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 238.459564] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:10.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"69f2d595b06fa52d4338b3fa","created_at":"2026-08-12T13:12:04.922Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89c6f1f9c10aee2e76821407a35476a2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.956Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-69f2d595b06fa52d4338b3fa: start","job_status":"start","queue_duration_s":5.320592,"scheduling_latency_s":5.320654}1266gitlab # [ 239.184216] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"69f2d595b06fa52d4338b3fa","created_at":"2026-08-12T13:12:04.922Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89c6f1f9c10aee2e76821407a35476a2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:04.956Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-69f2d595b06fa52d4338b3fa: done: 0.800226 sec","job_status":"done","queue_duration_s":5.320592,"scheduling_latency_s":5.320654,"redis_calls":565,"redis_duration_s":0.386498,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007776,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.368893,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.452179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003449,"duration_s":0.800226,"completed_at":"2026-08-12T13:12:11.077Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013976,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 239.184755] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a50c311377250bff13d85c66","created_at":"2026-08-12T13:12:05.000Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1616dfb23aa35b0162f3b979214d3a64","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:05.049Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a50c311377250bff13d85c66: start","job_status":"start","queue_duration_s":6.029463,"scheduling_latency_s":6.029492}1268gitlab # [ 239.287746] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.134Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a50c311377250bff13d85c66","created_at":"2026-08-12T13:12:05.000Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1616dfb23aa35b0162f3b979214d3a64","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:05.049Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a50c311377250bff13d85c66: done: 0.05612 sec","job_status":"done","queue_duration_s":6.029463,"scheduling_latency_s":6.029492,"redis_calls":10,"redis_duration_s":0.002886,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000594,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004716,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.05612,"completed_at":"2026-08-12T13:12:11.134Z","load_balancing_strategy":"primary","db_duration_s":0.030813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 240.012081] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"209c571bd7d54a6d70d223c6","created_at":"2026-08-12T13:12:05.082Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfa48633031c803630bdc5be8a7e383b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:05.228Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-209c571bd7d54a6d70d223c6: start","job_status":"start","queue_duration_s":5.908821,"scheduling_latency_s":5.908845}1270gitlab # [ 240.065391] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.150Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1271gitlab # [ 240.070807] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"209c571bd7d54a6d70d223c6","created_at":"2026-08-12T13:12:05.082Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfa48633031c803630bdc5be8a7e383b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:05.228Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-209c571bd7d54a6d70d223c6: done: 0.020771 sec","job_status":"done","queue_duration_s":5.908821,"scheduling_latency_s":5.908845,"redis_calls":10,"redis_duration_s":0.002511,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000611,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035276,"duration_s":0.020771,"completed_at":"2026-08-12T13:12:11.158Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 240.122761] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4ed7334781199ecc66c1f185","created_at":"2026-08-12T13:12:05.289Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec24b3955ea3e9137ed0759a30c56aaa","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:05.339Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4ed7334781199ecc66c1f185: start","job_status":"start","queue_duration_s":5.820644,"scheduling_latency_s":5.820664}1273gitlab # [ 240.137514] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.194Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4ed7334781199ecc66c1f185","created_at":"2026-08-12T13:12:05.289Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec24b3955ea3e9137ed0759a30c56aaa","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:05.339Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4ed7334781199ecc66c1f185: done: 0.034351 sec","job_status":"done","queue_duration_s":5.820644,"scheduling_latency_s":5.820664,"redis_calls":13,"redis_duration_s":0.003491,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000554,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001784,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01158494,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.034351,"completed_at":"2026-08-12T13:12:11.193Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005032,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1274gitlab # [ 240.181935] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.195Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4f2b9c6f1388ea8ef9db16bc","created_at":"2026-08-12T13:12:05.417Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58eac03fc85f7f02a009a67e8388c7b4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:05.507Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4f2b9c6f1388ea8ef9db16bc: start","job_status":"start","queue_duration_s":5.687881,"scheduling_latency_s":5.687901}1275gitlab # [ 240.197717] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4f2b9c6f1388ea8ef9db16bc","created_at":"2026-08-12T13:12:05.417Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58eac03fc85f7f02a009a67e8388c7b4","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-12T13:12:05.507Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4f2b9c6f1388ea8ef9db16bc: done: 0.029144 sec","job_status":"done","queue_duration_s":5.687881,"scheduling_latency_s":5.687901,"redis_calls":10,"redis_duration_s":0.002593,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001537,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036738,"duration_s":0.029144,"completed_at":"2026-08-12T13:12:11.224Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 240.239910] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a52d414166162772a07159e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a52d414166162772a07159e: start","job_status":"start","queue_duration_s":3.530567,"scheduling_latency_s":3.530586}1277gitlab # [ 240.252691] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a52d414166162772a07159e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a52d414166162772a07159e: done: 0.025357 sec","job_status":"done","queue_duration_s":3.530567,"scheduling_latency_s":3.530586,"redis_calls":16,"redis_duration_s":0.004153,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002472,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003157,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025357,"completed_at":"2026-08-12T13:12:11.251Z","load_balancing_strategy":"primary","db_duration_s":0.000724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 240.293972] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0ae0c516ff730ba63823105","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0ae0c516ff730ba63823105: start","job_status":"start","queue_duration_s":3.557394,"scheduling_latency_s":3.557411}1279gitlab # [ 240.306569] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0ae0c516ff730ba63823105","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0ae0c516ff730ba63823105: done: 0.017576 sec","job_status":"done","queue_duration_s":3.557394,"scheduling_latency_s":3.557411,"redis_calls":13,"redis_duration_s":0.00349,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002539,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017576,"completed_at":"2026-08-12T13:12:11.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 240.346034] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7a4bf221aa5bc5fe7027145","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7a4bf221aa5bc5fe7027145: start","job_status":"start","queue_duration_s":3.576394,"scheduling_latency_s":3.576411}1281gitlab # [ 240.358634] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7a4bf221aa5bc5fe7027145","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7a4bf221aa5bc5fe7027145: done: 0.016751 sec","job_status":"done","queue_duration_s":3.576394,"scheduling_latency_s":3.576411,"redis_calls":13,"redis_duration_s":0.002706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016751,"completed_at":"2026-08-12T13:12:11.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 240.399133] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a7cae929c45bffef2c1fb0f","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a7cae929c45bffef2c1fb0f: start","job_status":"start","queue_duration_s":3.594453,"scheduling_latency_s":3.594469}1283gitlab # [ 240.411866] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a7cae929c45bffef2c1fb0f","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a7cae929c45bffef2c1fb0f: done: 0.016651 sec","job_status":"done","queue_duration_s":3.594453,"scheduling_latency_s":3.594469,"redis_calls":13,"redis_duration_s":0.002891,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016651,"completed_at":"2026-08-12T13:12:11.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 240.451619] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a5bcb50c689b73066b4d530","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a5bcb50c689b73066b4d530: start","job_status":"start","queue_duration_s":3.612468,"scheduling_latency_s":3.612485}1285gitlab # [ 240.464375] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a5bcb50c689b73066b4d530","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a5bcb50c689b73066b4d530: done: 0.021039 sec","job_status":"done","queue_duration_s":3.612468,"scheduling_latency_s":3.612485,"redis_calls":13,"redis_duration_s":0.005333,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001391,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021039,"completed_at":"2026-08-12T13:12:11.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 240.503759] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad1e49e7316ac81c2f2cb2ac","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad1e49e7316ac81c2f2cb2ac: start","job_status":"start","queue_duration_s":3.634882,"scheduling_latency_s":3.634899}1287gitlab # [ 240.516554] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad1e49e7316ac81c2f2cb2ac","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad1e49e7316ac81c2f2cb2ac: done: 0.015427 sec","job_status":"done","queue_duration_s":3.634882,"scheduling_latency_s":3.634899,"redis_calls":13,"redis_duration_s":0.002796,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015427,"completed_at":"2026-08-12T13:12:11.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 240.555945] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b419190861dc9fb00892ad4a","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b419190861dc9fb00892ad4a: start","job_status":"start","queue_duration_s":3.651684,"scheduling_latency_s":3.651701}1289gitlab # [ 240.568735] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b419190861dc9fb00892ad4a","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b419190861dc9fb00892ad4a: done: 0.020335 sec","job_status":"done","queue_duration_s":3.651684,"scheduling_latency_s":3.651701,"redis_calls":13,"redis_duration_s":0.003091,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001422,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020335,"completed_at":"2026-08-12T13:12:11.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 240.609068] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38fd754a10e704eca6605e34","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38fd754a10e704eca6605e34: start","job_status":"start","queue_duration_s":3.673396,"scheduling_latency_s":3.673413}1291gitlab # [ 240.621505] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38fd754a10e704eca6605e34","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38fd754a10e704eca6605e34: done: 0.014923 sec","job_status":"done","queue_duration_s":3.673396,"scheduling_latency_s":3.673413,"redis_calls":13,"redis_duration_s":0.002659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014923,"completed_at":"2026-08-12T13:12:11.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 240.660537] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c4fe321c12e17c815850ea9","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c4fe321c12e17c815850ea9: start","job_status":"start","queue_duration_s":3.689763,"scheduling_latency_s":3.689781}1293gitlab # [ 240.672870] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c4fe321c12e17c815850ea9","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c4fe321c12e17c815850ea9: done: 0.014866 sec","job_status":"done","queue_duration_s":3.689763,"scheduling_latency_s":3.689781,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001796,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014866,"completed_at":"2026-08-12T13:12:11.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 240.712070] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8548c1bb0a2ec2a745cf5c1d","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8548c1bb0a2ec2a745cf5c1d: start","job_status":"start","queue_duration_s":3.706002,"scheduling_latency_s":3.706019}1295gitlab # [ 240.724471] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8548c1bb0a2ec2a745cf5c1d","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8548c1bb0a2ec2a745cf5c1d: done: 0.014639 sec","job_status":"done","queue_duration_s":3.706002,"scheduling_latency_s":3.706019,"redis_calls":13,"redis_duration_s":0.002656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001729,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014639,"completed_at":"2026-08-12T13:12:11.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 240.763570] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7185162349b57b4f12968ae3","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7185162349b57b4f12968ae3: start","job_status":"start","queue_duration_s":3.721982,"scheduling_latency_s":3.721998}1297gitlab # [ 240.776181] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7185162349b57b4f12968ae3","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7185162349b57b4f12968ae3: done: 0.014738 sec","job_status":"done","queue_duration_s":3.721982,"scheduling_latency_s":3.721998,"redis_calls":13,"redis_duration_s":0.002781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001829,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014738,"completed_at":"2026-08-12T13:12:11.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 240.816339] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26b945f35e128a024bf09359","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26b945f35e128a024bf09359: start","job_status":"start","queue_duration_s":3.738175,"scheduling_latency_s":3.738192}1299gitlab # [ 240.828645] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26b945f35e128a024bf09359","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26b945f35e128a024bf09359: done: 0.014947 sec","job_status":"done","queue_duration_s":3.738175,"scheduling_latency_s":3.738192,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014947,"completed_at":"2026-08-12T13:12:11.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 240.867690] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b3f4523527483712a0be5f0","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b3f4523527483712a0be5f0: start","job_status":"start","queue_duration_s":3.754468,"scheduling_latency_s":3.754484}1301gitlab # [ 240.880786] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b3f4523527483712a0be5f0","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b3f4523527483712a0be5f0: done: 0.014626 sec","job_status":"done","queue_duration_s":3.754468,"scheduling_latency_s":3.754484,"redis_calls":13,"redis_duration_s":0.00252,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001603,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014626,"completed_at":"2026-08-12T13:12:11.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 240.920127] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d022c27a97d4b081b50f6719","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d022c27a97d4b081b50f6719: start","job_status":"start","queue_duration_s":3.770533,"scheduling_latency_s":3.77055}1303gitlab # [ 240.932683] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d022c27a97d4b081b50f6719","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d022c27a97d4b081b50f6719: done: 0.014793 sec","job_status":"done","queue_duration_s":3.770533,"scheduling_latency_s":3.77055,"redis_calls":13,"redis_duration_s":0.002636,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014793,"completed_at":"2026-08-12T13:12:11.481Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 240.971735] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86a5881d7f0c504afefe173e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86a5881d7f0c504afefe173e: start","job_status":"start","queue_duration_s":3.786577,"scheduling_latency_s":3.786594}1305gitlab # [ 240.984390] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86a5881d7f0c504afefe173e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86a5881d7f0c504afefe173e: done: 0.014423 sec","job_status":"done","queue_duration_s":3.786577,"scheduling_latency_s":3.786594,"redis_calls":13,"redis_duration_s":0.002475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001574,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014423,"completed_at":"2026-08-12T13:12:11.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 241.024531] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b8eeacdee8430174ea23ef3","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b8eeacdee8430174ea23ef3: start","job_status":"start","queue_duration_s":3.802365,"scheduling_latency_s":3.802382}1307gitlab # [ 241.036883] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b8eeacdee8430174ea23ef3","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b8eeacdee8430174ea23ef3: done: 0.014981 sec","job_status":"done","queue_duration_s":3.802365,"scheduling_latency_s":3.802382,"redis_calls":13,"redis_duration_s":0.002816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014981,"completed_at":"2026-08-12T13:12:11.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 241.075976] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d79970cb6f8bb0ffc9c86242","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d79970cb6f8bb0ffc9c86242: start","job_status":"start","queue_duration_s":3.818679,"scheduling_latency_s":3.818711}1309gitlab # [ 241.088681] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d79970cb6f8bb0ffc9c86242","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d79970cb6f8bb0ffc9c86242: done: 0.01451 sec","job_status":"done","queue_duration_s":3.818679,"scheduling_latency_s":3.818711,"redis_calls":13,"redis_duration_s":0.002493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001596,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01451,"completed_at":"2026-08-12T13:12:11.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 241.127762] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16fc41a58e54b7b8e910cb17","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16fc41a58e54b7b8e910cb17: start","job_status":"start","queue_duration_s":3.834363,"scheduling_latency_s":3.834379}1311gitlab # [ 241.140496] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16fc41a58e54b7b8e910cb17","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16fc41a58e54b7b8e910cb17: done: 0.015202 sec","job_status":"done","queue_duration_s":3.834363,"scheduling_latency_s":3.834379,"redis_calls":13,"redis_duration_s":0.002977,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015202,"completed_at":"2026-08-12T13:12:11.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 241.180502] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8837553975e04c9d00c4cda5","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8837553975e04c9d00c4cda5: start","job_status":"start","queue_duration_s":3.850943,"scheduling_latency_s":3.85096}1313gitlab # [ 241.192815] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8837553975e04c9d00c4cda5","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8837553975e04c9d00c4cda5: done: 0.014887 sec","job_status":"done","queue_duration_s":3.850943,"scheduling_latency_s":3.85096,"redis_calls":13,"redis_duration_s":0.002742,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014887,"completed_at":"2026-08-12T13:12:11.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 241.233784] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71a0c63138950165a2987fd5","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71a0c63138950165a2987fd5: start","job_status":"start","queue_duration_s":3.867316,"scheduling_latency_s":3.867333}1315gitlab # [ 241.246308] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71a0c63138950165a2987fd5","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71a0c63138950165a2987fd5: done: 0.014835 sec","job_status":"done","queue_duration_s":3.867316,"scheduling_latency_s":3.867333,"redis_calls":13,"redis_duration_s":0.002676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014835,"completed_at":"2026-08-12T13:12:11.578Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 241.285746] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fbe3331af489b69f6cbcb31","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fbe3331af489b69f6cbcb31: start","job_status":"start","queue_duration_s":3.883433,"scheduling_latency_s":3.88345}1317gitlab # [ 241.298507] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fbe3331af489b69f6cbcb31","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fbe3331af489b69f6cbcb31: done: 0.014776 sec","job_status":"done","queue_duration_s":3.883433,"scheduling_latency_s":3.88345,"redis_calls":13,"redis_duration_s":0.002638,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001735,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014776,"completed_at":"2026-08-12T13:12:11.594Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 241.337399] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1cdc07b36ddf9dc9571a12","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1cdc07b36ddf9dc9571a12: start","job_status":"start","queue_duration_s":3.899534,"scheduling_latency_s":3.899551}1319gitlab # [ 241.349654] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1cdc07b36ddf9dc9571a12","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1cdc07b36ddf9dc9571a12: done: 0.014916 sec","job_status":"done","queue_duration_s":3.899534,"scheduling_latency_s":3.899551,"redis_calls":13,"redis_duration_s":0.00269,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014916,"completed_at":"2026-08-12T13:12:11.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 241.388537] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3210097c10b56216f927efc","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3210097c10b56216f927efc: start","job_status":"start","queue_duration_s":3.915818,"scheduling_latency_s":3.915836}1321gitlab # [ 241.400557] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3210097c10b56216f927efc","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3210097c10b56216f927efc: done: 0.014622 sec","job_status":"done","queue_duration_s":3.915818,"scheduling_latency_s":3.915836,"redis_calls":13,"redis_duration_s":0.002599,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001708,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014622,"completed_at":"2026-08-12T13:12:11.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 241.440241] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e61fc50f52c9d4edcde8838c","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e61fc50f52c9d4edcde8838c: start","job_status":"start","queue_duration_s":3.93181,"scheduling_latency_s":3.931828}1323gitlab # [ 241.452529] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e61fc50f52c9d4edcde8838c","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e61fc50f52c9d4edcde8838c: done: 0.01478 sec","job_status":"done","queue_duration_s":3.93181,"scheduling_latency_s":3.931828,"redis_calls":13,"redis_duration_s":0.002673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001759,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01478,"completed_at":"2026-08-12T13:12:11.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 241.490996] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7653a9da3f5b1dc6e66e453","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7653a9da3f5b1dc6e66e453: start","job_status":"start","queue_duration_s":3.94808,"scheduling_latency_s":3.948098}1325gitlab # [ 241.503380] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7653a9da3f5b1dc6e66e453","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7653a9da3f5b1dc6e66e453: done: 0.014857 sec","job_status":"done","queue_duration_s":3.94808,"scheduling_latency_s":3.948098,"redis_calls":13,"redis_duration_s":0.002708,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014857,"completed_at":"2026-08-12T13:12:11.658Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 241.541886] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c91f394b65f673db355d18b","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c91f394b65f673db355d18b: start","job_status":"start","queue_duration_s":3.964226,"scheduling_latency_s":3.964242}1327gitlab # [ 241.554182] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c91f394b65f673db355d18b","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c91f394b65f673db355d18b: done: 0.014877 sec","job_status":"done","queue_duration_s":3.964226,"scheduling_latency_s":3.964242,"redis_calls":13,"redis_duration_s":0.002695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014877,"completed_at":"2026-08-12T13:12:11.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 241.592478] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8027369c114b972bb94654dc","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8027369c114b972bb94654dc: start","job_status":"start","queue_duration_s":3.980576,"scheduling_latency_s":3.980593}1329gitlab # [ 241.604432] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8027369c114b972bb94654dc","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8027369c114b972bb94654dc: done: 0.014801 sec","job_status":"done","queue_duration_s":3.980576,"scheduling_latency_s":3.980593,"redis_calls":13,"redis_duration_s":0.002735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001798,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014801,"completed_at":"2026-08-12T13:12:11.691Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 241.643990] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57e7d64855d050457a4e8a05","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57e7d64855d050457a4e8a05: start","job_status":"start","queue_duration_s":3.996732,"scheduling_latency_s":3.99675}1331gitlab # [ 241.655922] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57e7d64855d050457a4e8a05","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57e7d64855d050457a4e8a05: done: 0.01467 sec","job_status":"done","queue_duration_s":3.996732,"scheduling_latency_s":3.99675,"redis_calls":13,"redis_duration_s":0.002632,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01467,"completed_at":"2026-08-12T13:12:11.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 241.694625] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"250e088cdf973d5580c5900f","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-250e088cdf973d5580c5900f: start","job_status":"start","queue_duration_s":4.012755,"scheduling_latency_s":4.012771}1333gitlab # [ 241.706844] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"250e088cdf973d5580c5900f","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-250e088cdf973d5580c5900f: done: 0.01492 sec","job_status":"done","queue_duration_s":4.012755,"scheduling_latency_s":4.012771,"redis_calls":13,"redis_duration_s":0.002682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01492,"completed_at":"2026-08-12T13:12:11.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 241.745234] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f5181d72eb3fabea081ec41","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f5181d72eb3fabea081ec41: start","job_status":"start","queue_duration_s":4.028991,"scheduling_latency_s":4.029019}1335gitlab # [ 241.757491] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f5181d72eb3fabea081ec41","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f5181d72eb3fabea081ec41: done: 0.014842 sec","job_status":"done","queue_duration_s":4.028991,"scheduling_latency_s":4.029019,"redis_calls":13,"redis_duration_s":0.002667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001668,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014842,"completed_at":"2026-08-12T13:12:11.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 241.795981] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f03b4e7c5027064151c6f034","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f03b4e7c5027064151c6f034: start","job_status":"start","queue_duration_s":4.045034,"scheduling_latency_s":4.045054}1337gitlab # [ 241.808406] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f03b4e7c5027064151c6f034","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f03b4e7c5027064151c6f034: done: 0.020831 sec","job_status":"done","queue_duration_s":4.045034,"scheduling_latency_s":4.045054,"redis_calls":13,"redis_duration_s":0.002765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020831,"completed_at":"2026-08-12T13:12:11.761Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 241.848412] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3920730bca7597f6d40be248","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3920730bca7597f6d40be248: start","job_status":"start","queue_duration_s":4.069872,"scheduling_latency_s":4.069921}1339gitlab # [ 241.885684] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3920730bca7597f6d40be248","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3920730bca7597f6d40be248: done: 0.036495 sec","job_status":"done","queue_duration_s":4.069872,"scheduling_latency_s":4.069921,"redis_calls":13,"redis_duration_s":0.003204,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001075,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036495,"completed_at":"2026-08-12T13:12:11.802Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 241.960117] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16beb764141ef8d87edc653d","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16beb764141ef8d87edc653d: start","job_status":"start","queue_duration_s":4.108346,"scheduling_latency_s":4.10838}1341gitlab # [ 241.979313] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16beb764141ef8d87edc653d","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16beb764141ef8d87edc653d: done: 0.025045 sec","job_status":"done","queue_duration_s":4.108346,"scheduling_latency_s":4.10838,"redis_calls":13,"redis_duration_s":0.002641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025045,"completed_at":"2026-08-12T13:12:11.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 242.030049] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d941f8938a3daf536e251a26","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d941f8938a3daf536e251a26: start","job_status":"start","queue_duration_s":4.135012,"scheduling_latency_s":4.135037}1343gitlab # [ 242.045395] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d941f8938a3daf536e251a26","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d941f8938a3daf536e251a26: done: 0.019603 sec","job_status":"done","queue_duration_s":4.135012,"scheduling_latency_s":4.135037,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019603,"completed_at":"2026-08-12T13:12:11.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 242.118627] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f318a751946770b059d161a","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f318a751946770b059d161a: start","job_status":"start","queue_duration_s":4.156278,"scheduling_latency_s":4.1563}1345gitlab # [ 242.144069] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f318a751946770b059d161a","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f318a751946770b059d161a: done: 0.017391 sec","job_status":"done","queue_duration_s":4.156278,"scheduling_latency_s":4.1563,"redis_calls":13,"redis_duration_s":0.002877,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017391,"completed_at":"2026-08-12T13:12:11.869Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 242.194348] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2113708a05e65061aa7ee78a","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2113708a05e65061aa7ee78a: start","job_status":"start","queue_duration_s":4.17657,"scheduling_latency_s":4.176626}1347gitlab # [ 242.207004] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2113708a05e65061aa7ee78a","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2113708a05e65061aa7ee78a: done: 0.036246 sec","job_status":"done","queue_duration_s":4.17657,"scheduling_latency_s":4.176626,"redis_calls":13,"redis_duration_s":0.004176,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001359,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036246,"completed_at":"2026-08-12T13:12:11.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 242.246118] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.911Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a098f2c3b3c5f69cdf502095","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a098f2c3b3c5f69cdf502095: start","job_status":"start","queue_duration_s":4.215342,"scheduling_latency_s":4.215381}1349gitlab # [ 242.259361] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a098f2c3b3c5f69cdf502095","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a098f2c3b3c5f69cdf502095: done: 0.028587 sec","job_status":"done","queue_duration_s":4.215342,"scheduling_latency_s":4.215381,"redis_calls":13,"redis_duration_s":0.003377,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002338,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028587,"completed_at":"2026-08-12T13:12:11.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 242.298014] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ccaa44ba21ac8c8b0de73bd","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ccaa44ba21ac8c8b0de73bd: start","job_status":"start","queue_duration_s":4.24603,"scheduling_latency_s":4.246058}1351gitlab # [ 242.310416] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ccaa44ba21ac8c8b0de73bd","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ccaa44ba21ac8c8b0de73bd: done: 0.023543 sec","job_status":"done","queue_duration_s":4.24603,"scheduling_latency_s":4.246058,"redis_calls":13,"redis_duration_s":0.00324,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023543,"completed_at":"2026-08-12T13:12:11.965Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 242.349102] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04a4ad9652e4dd6e80f58d3e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04a4ad9652e4dd6e80f58d3e: start","job_status":"start","queue_duration_s":4.271468,"scheduling_latency_s":4.271492}1353gitlab # [ 242.361258] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04a4ad9652e4dd6e80f58d3e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04a4ad9652e4dd6e80f58d3e: done: 0.020182 sec","job_status":"done","queue_duration_s":4.271468,"scheduling_latency_s":4.271492,"redis_calls":13,"redis_duration_s":0.003057,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020182,"completed_at":"2026-08-12T13:12:11.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 242.399676] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:11.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87ae766948ef86416230327f","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87ae766948ef86416230327f: start","job_status":"start","queue_duration_s":4.293312,"scheduling_latency_s":4.293335}1355gitlab # [ 242.412187] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87ae766948ef86416230327f","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87ae766948ef86416230327f: done: 0.019342 sec","job_status":"done","queue_duration_s":4.293312,"scheduling_latency_s":4.293335,"redis_calls":13,"redis_duration_s":0.003314,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001307,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019342,"completed_at":"2026-08-12T13:12:12.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 242.451801] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12fdd2408663e34b1ff502d0","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12fdd2408663e34b1ff502d0: start","job_status":"start","queue_duration_s":4.31425,"scheduling_latency_s":4.314271}1357gitlab # [ 242.464237] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12fdd2408663e34b1ff502d0","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12fdd2408663e34b1ff502d0: done: 0.017775 sec","job_status":"done","queue_duration_s":4.31425,"scheduling_latency_s":4.314271,"redis_calls":13,"redis_duration_s":0.002883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017775,"completed_at":"2026-08-12T13:12:12.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 242.502812] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10a46abbef3730b14696c07e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10a46abbef3730b14696c07e: start","job_status":"start","queue_duration_s":4.333485,"scheduling_latency_s":4.333503}1359gitlab # [ 242.515140] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10a46abbef3730b14696c07e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10a46abbef3730b14696c07e: done: 0.016158 sec","job_status":"done","queue_duration_s":4.333485,"scheduling_latency_s":4.333503,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016158,"completed_at":"2026-08-12T13:12:12.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 242.553824] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd798b46dd887e901e823e7e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd798b46dd887e901e823e7e: start","job_status":"start","queue_duration_s":4.351021,"scheduling_latency_s":4.351039}1361gitlab # [ 242.566029] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd798b46dd887e901e823e7e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd798b46dd887e901e823e7e: done: 0.014889 sec","job_status":"done","queue_duration_s":4.351021,"scheduling_latency_s":4.351039,"redis_calls":13,"redis_duration_s":0.002654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014889,"completed_at":"2026-08-12T13:12:12.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 242.604415] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67bc8ad8e0593c660959b5fc","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67bc8ad8e0593c660959b5fc: start","job_status":"start","queue_duration_s":4.367141,"scheduling_latency_s":4.367158}1363gitlab # [ 242.616448] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67bc8ad8e0593c660959b5fc","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67bc8ad8e0593c660959b5fc: done: 0.014998 sec","job_status":"done","queue_duration_s":4.367141,"scheduling_latency_s":4.367158,"redis_calls":13,"redis_duration_s":0.00296,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014998,"completed_at":"2026-08-12T13:12:12.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 242.656455] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5494378f66500a4d06dbe373","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5494378f66500a4d06dbe373: start","job_status":"start","queue_duration_s":4.38493,"scheduling_latency_s":4.38498}1365gitlab # [ 242.668713] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5494378f66500a4d06dbe373","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5494378f66500a4d06dbe373: done: 0.036416 sec","job_status":"done","queue_duration_s":4.38493,"scheduling_latency_s":4.38498,"redis_calls":13,"redis_duration_s":0.0034479999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001142,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002306,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036416,"completed_at":"2026-08-12T13:12:12.117Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 242.707544] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46c222577287c82566f3157a","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46c222577287c82566f3157a: start","job_status":"start","queue_duration_s":4.423902,"scheduling_latency_s":4.423953}1367gitlab # [ 242.720125] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46c222577287c82566f3157a","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46c222577287c82566f3157a: done: 0.03121 sec","job_status":"done","queue_duration_s":4.423902,"scheduling_latency_s":4.423953,"redis_calls":13,"redis_duration_s":0.0034690000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001275,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03121,"completed_at":"2026-08-12T13:12:12.150Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 242.758769] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d98b0b93512e3c06410c43be","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d98b0b93512e3c06410c43be: start","job_status":"start","queue_duration_s":4.457277,"scheduling_latency_s":4.457311}1369gitlab # [ 242.771217] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d98b0b93512e3c06410c43be","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d98b0b93512e3c06410c43be: done: 0.030664 sec","job_status":"done","queue_duration_s":4.457277,"scheduling_latency_s":4.457311,"redis_calls":13,"redis_duration_s":0.003859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002471,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030664,"completed_at":"2026-08-12T13:12:12.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 242.810218] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4462466e26980699de78a1b4","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4462466e26980699de78a1b4: start","job_status":"start","queue_duration_s":4.490733,"scheduling_latency_s":4.490776}1371gitlab # [ 242.822341] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4462466e26980699de78a1b4","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4462466e26980699de78a1b4: done: 0.031985 sec","job_status":"done","queue_duration_s":4.490733,"scheduling_latency_s":4.490776,"redis_calls":13,"redis_duration_s":0.0038789999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001273,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002606,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031985,"completed_at":"2026-08-12T13:12:12.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 242.862906] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66fba61f47514c997d99222e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66fba61f47514c997d99222e: start","job_status":"start","queue_duration_s":4.525026,"scheduling_latency_s":4.525064}1373gitlab # [ 242.875677] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66fba61f47514c997d99222e","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66fba61f47514c997d99222e: done: 0.026591 sec","job_status":"done","queue_duration_s":4.525026,"scheduling_latency_s":4.525064,"redis_calls":13,"redis_duration_s":0.003407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00228,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026591,"completed_at":"2026-08-12T13:12:12.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 242.915519] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1562de1e3d0779c047228509","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1562de1e3d0779c047228509: start","job_status":"start","queue_duration_s":4.553318,"scheduling_latency_s":4.553343}1375gitlab # [ 242.928286] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1562de1e3d0779c047228509","created_at":"2026-08-12T13:12:07.172Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-9c5169fd7d604cfe","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7322f630b5e3542c537e11b956ba5655","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:07.695Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1562de1e3d0779c047228509: done: 0.020161 sec","job_status":"done","queue_duration_s":4.553318,"scheduling_latency_s":4.553343,"redis_calls":13,"redis_duration_s":0.003053,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020161,"completed_at":"2026-08-12T13:12:12.269Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 242.967838] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.270Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"509855980e3dd6c7f06315ad","created_at":"2026-08-12T13:12:08.573Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-73d4ee509fe8492e","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:08.669Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-509855980e3dd6c7f06315ad: start","job_status":"start","queue_duration_s":3.601212,"scheduling_latency_s":3.601232}1377gitlab # [ 242.980605] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.292Z","message":"No existing merge request to be cleaned up."}1378gitlab # [ 242.982287] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.308Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"509855980e3dd6c7f06315ad","created_at":"2026-08-12T13:12:08.573Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-73d4ee509fe8492e","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:08.669Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-509855980e3dd6c7f06315ad: done: 0.037339 sec","job_status":"done","queue_duration_s":3.601212,"scheduling_latency_s":3.601232,"redis_calls":13,"redis_duration_s":0.003146,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001504,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003688,"duration_s":0.037339,"completed_at":"2026-08-12T13:12:12.308Z","load_balancing_strategy":"primary","db_duration_s":0.006255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 243.022617] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.309Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc4bcb158197e3425cc14c6b","created_at":"2026-08-12T13:12:08.573Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-73d4ee509fe8492e","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:08.669Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc4bcb158197e3425cc14c6b: start","job_status":"start","queue_duration_s":3.640068,"scheduling_latency_s":3.640086}1380gitlab # [ 243.035109] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.322Z","message":"No existing merge request to be cleaned up."}1381gitlab # [ 243.036867] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.332Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc4bcb158197e3425cc14c6b","created_at":"2026-08-12T13:12:08.573Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-73d4ee509fe8492e","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:08.669Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc4bcb158197e3425cc14c6b: done: 0.022434 sec","job_status":"done","queue_duration_s":3.640068,"scheduling_latency_s":3.640086,"redis_calls":10,"redis_duration_s":0.002541,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00154,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022434,"completed_at":"2026-08-12T13:12:12.332Z","load_balancing_strategy":"primary","db_duration_s":0.001838,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 243.076607] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.333Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"057e2e432d05a8ad04cfd80b","created_at":"2026-08-12T13:12:08.573Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-73d4ee509fe8492e","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:08.669Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-057e2e432d05a8ad04cfd80b: start","job_status":"start","queue_duration_s":3.664166,"scheduling_latency_s":3.664185}1383gitlab # [ 243.088975] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.345Z","message":"No existing merge request to be cleaned up."}1384gitlab # [ 243.090638] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.353Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"057e2e432d05a8ad04cfd80b","created_at":"2026-08-12T13:12:08.573Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-73d4ee509fe8492e","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:08.669Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-057e2e432d05a8ad04cfd80b: done: 0.019769 sec","job_status":"done","queue_duration_s":3.664166,"scheduling_latency_s":3.664185,"redis_calls":10,"redis_duration_s":0.002319,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001451,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019769,"completed_at":"2026-08-12T13:12:12.353Z","load_balancing_strategy":"primary","db_duration_s":0.001298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 243.129211] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.355Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b8dcbfd20d305a08647287b6","created_at":"2026-08-12T13:12:08.573Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-73d4ee509fe8492e","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:08.669Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b8dcbfd20d305a08647287b6: start","job_status":"start","queue_duration_s":3.685449,"scheduling_latency_s":3.685468}1386gitlab # [ 243.141603] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.365Z","message":"No existing merge request to be cleaned up."}1387gitlab # [ 243.143243] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:12:12.374Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b8dcbfd20d305a08647287b6","created_at":"2026-08-12T13:12:08.573Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-73d4ee509fe8492e","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4c994b4e8b7ed11f31ea397ccb37f7cc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:12:08.669Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b8dcbfd20d305a08647287b6: done: 0.018877 sec","job_status":"done","queue_duration_s":3.685449,"scheduling_latency_s":3.685468,"redis_calls":10,"redis_duration_s":0.0023150000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001387,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018877,"completed_at":"2026-08-12T13:12:12.374Z","load_balancing_strategy":"primary","db_duration_s":0.001225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 266.244579] setup-gitlab-start[2910]: W, [2026-08-12T13:12:38.137825 #2910] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1389gitlab # [ 289.264690] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"898eea2ff9ad724dc5e71f8b","created_at":"2026-08-12T13:13:01.131Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa6c77149a626da464fd100dc5f63118","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.151Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-898eea2ff9ad724dc5e71f8b: start","job_status":"start","queue_duration_s":0.00345,"scheduling_latency_s":0.003514}1390gitlab # [ 289.394124] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.288Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1391gitlab # [ 289.453791] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"898eea2ff9ad724dc5e71f8b","created_at":"2026-08-12T13:13:01.131Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa6c77149a626da464fd100dc5f63118","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.151Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-898eea2ff9ad724dc5e71f8b: done: 0.191771 sec","job_status":"done","queue_duration_s":0.00345,"scheduling_latency_s":0.003514,"redis_calls":14,"redis_duration_s":0.028387,"redis_read_bytes":777,"redis_write_bytes":1230,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.0098,"redis_feature_flag_read_bytes":768,"redis_feature_flag_write_bytes":400,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011632,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006955,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.191771,"completed_at":"2026-08-12T13:13:01.346Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 289.546122] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.413Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"59fbca4bc4bfa44f8bbd337b","created_at":"2026-08-12T13:13:01.167Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8970df63a6c7919f66947adab72a5bf2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.175Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-59fbca4bc4bfa44f8bbd337b: start","job_status":"start","queue_duration_s":0.238588,"scheduling_latency_s":0.238648}1393gitlab # [ 289.699434] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.593Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1394gitlab # [ 289.740255] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"59fbca4bc4bfa44f8bbd337b","created_at":"2026-08-12T13:13:01.167Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8970df63a6c7919f66947adab72a5bf2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.175Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-59fbca4bc4bfa44f8bbd337b: done: 0.219802 sec","job_status":"done","queue_duration_s":0.238588,"scheduling_latency_s":0.238648,"redis_calls":7,"redis_duration_s":0.012701,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009032,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003669,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.219802,"completed_at":"2026-08-12T13:13:01.633Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 289.829819] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d63fa5619da83ec4049484da","created_at":"2026-08-12T13:13:01.222Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd4ca3e77651144bb9313cc9b0a2e6a0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.229Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d63fa5619da83ec4049484da: start","job_status":"start","queue_duration_s":0.411216,"scheduling_latency_s":0.411271}1396gitlab # [ 289.948692] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.841Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d63fa5619da83ec4049484da","created_at":"2026-08-12T13:13:01.222Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd4ca3e77651144bb9313cc9b0a2e6a0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.229Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d63fa5619da83ec4049484da: done: 0.201264 sec","job_status":"done","queue_duration_s":0.411216,"scheduling_latency_s":0.411271,"redis_calls":9,"redis_duration_s":0.016569,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003592,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00154318,"exclusive_lock_hold_duration_s":0.08370874,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.201264,"completed_at":"2026-08-12T13:13:01.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.074727,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 290.013586] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2d84ae38360503bdd07d336f","created_at":"2026-08-12T13:13:01.238Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d26f8df855e244906ae8f6d4c10c815","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.244Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2d84ae38360503bdd07d336f: start","job_status":"start","queue_duration_s":0.60227,"scheduling_latency_s":0.602321}1398gitlab # [ 290.027947] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2d84ae38360503bdd07d336f","created_at":"2026-08-12T13:13:01.238Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2d26f8df855e244906ae8f6d4c10c815","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.244Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2d84ae38360503bdd07d336f: done: 0.045332 sec","job_status":"done","queue_duration_s":0.60227,"scheduling_latency_s":0.602321,"redis_calls":10,"redis_duration_s":0.004117,"redis_read_bytes":135,"redis_write_bytes":1121,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000348,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00206,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001709,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00121848,"exclusive_lock_hold_duration_s":0.00887252,"duration_s":0.045332,"completed_at":"2026-08-12T13:13:01.891Z","load_balancing_strategy":"primary","db_duration_s":0.002128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 290.071140] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:01.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"68b94f8b48ae2b5986d5897d","created_at":"2026-08-12T13:13:01.266Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7e4148487ac82caa8f81380c2e1cbab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.276Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-68b94f8b48ae2b5986d5897d: start","job_status":"start","queue_duration_s":0.617946,"scheduling_latency_s":0.61799}1400gitlab # [ 290.429056] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"68b94f8b48ae2b5986d5897d","created_at":"2026-08-12T13:13:01.266Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7e4148487ac82caa8f81380c2e1cbab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.276Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-68b94f8b48ae2b5986d5897d: done: 0.426911 sec","job_status":"done","queue_duration_s":0.617946,"scheduling_latency_s":0.61799,"redis_calls":9,"redis_duration_s":0.003129,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001458,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.062,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.346212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00096424,"exclusive_lock_hold_duration_s":0.39792436,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.426911,"completed_at":"2026-08-12T13:13:02.321Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.096543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 290.533141] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.323Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d55ad9a11870768d90e05035","created_at":"2026-08-12T13:13:01.308Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"705794e30b23535bbf5b686176373576","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.319Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d55ad9a11870768d90e05035: start","job_status":"start","queue_duration_s":1.004304,"scheduling_latency_s":1.004333}1402gitlab # [ 290.552314] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.334Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1403gitlab # [ 290.556470] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.341Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d55ad9a11870768d90e05035","created_at":"2026-08-12T13:13:01.308Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"705794e30b23535bbf5b686176373576","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.319Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d55ad9a11870768d90e05035: done: 0.01796 sec","job_status":"done","queue_duration_s":1.004304,"scheduling_latency_s":1.004333,"redis_calls":7,"redis_duration_s":0.001924,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000526,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01796,"completed_at":"2026-08-12T13:13:02.341Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 290.598062] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"f051291151eb9c96099a0818","created_at":"2026-08-12T13:13:01.336Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f6e7baf9fe15bd2a7d3137c4ffe8e4","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.354Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-f051291151eb9c96099a0818: start","job_status":"start","queue_duration_s":0.989334,"scheduling_latency_s":0.989358}1405gitlab # [ 290.611305] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.389Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"f051291151eb9c96099a0818","created_at":"2026-08-12T13:13:01.336Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f6e7baf9fe15bd2a7d3137c4ffe8e4","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.354Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-f051291151eb9c96099a0818: done: 0.046074 sec","job_status":"done","queue_duration_s":0.989334,"scheduling_latency_s":0.989358,"redis_calls":12,"redis_duration_s":0.002519,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000366,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065036,"exclusive_lock_hold_duration_s":0.01448112,"duration_s":0.046074,"completed_at":"2026-08-12T13:13:02.389Z","load_balancing_strategy":"primary","db_duration_s":0.014947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 290.652603] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.391Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b21d8d14ba1e7a1d333ed9bf","created_at":"2026-08-12T13:13:01.375Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.382Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b21d8d14ba1e7a1d333ed9bf: start","job_status":"start","queue_duration_s":1.008611,"scheduling_latency_s":1.008637}1407gitlab # [ 290.666974] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b21d8d14ba1e7a1d333ed9bf","created_at":"2026-08-12T13:13:01.375Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.382Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b21d8d14ba1e7a1d333ed9bf: done: 0.09288 sec","job_status":"done","queue_duration_s":1.008611,"scheduling_latency_s":1.008637,"redis_calls":60,"redis_duration_s":0.008607,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000493,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.007617,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.09288,"completed_at":"2026-08-12T13:13:02.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 290.707960] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4ff83fc07308d0e2f8af3b66","created_at":"2026-08-12T13:13:01.412Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3cc9b6514c4c9ca9d2bfe6800382eef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.419Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4ff83fc07308d0e2f8af3b66: start","job_status":"start","queue_duration_s":1.065899,"scheduling_latency_s":1.06592}1409gitlab # [ 290.722529] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"4ff83fc07308d0e2f8af3b66","created_at":"2026-08-12T13:13:01.412Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3cc9b6514c4c9ca9d2bfe6800382eef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.419Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-4ff83fc07308d0e2f8af3b66: done: 0.013602 sec","job_status":"done","queue_duration_s":1.065899,"scheduling_latency_s":1.06592,"redis_calls":8,"redis_duration_s":0.001034,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000126,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013602,"completed_at":"2026-08-12T13:13:02.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 290.764387] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1c743403c547bc3ba3431c90","created_at":"2026-08-12T13:13:01.424Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba5818875e87a052a7b6e0b7d1c1f511","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.428Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1c743403c547bc3ba3431c90: start","job_status":"start","queue_duration_s":1.071686,"scheduling_latency_s":1.071706}1411gitlab # [ 290.778557] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1c743403c547bc3ba3431c90","created_at":"2026-08-12T13:13:01.424Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba5818875e87a052a7b6e0b7d1c1f511","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.428Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1c743403c547bc3ba3431c90: done: 0.015994 sec","job_status":"done","queue_duration_s":1.071686,"scheduling_latency_s":1.071706,"redis_calls":9,"redis_duration_s":0.001271,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000651,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00062,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045678,"exclusive_lock_hold_duration_s":0.00297396,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.015994,"completed_at":"2026-08-12T13:13:02.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 290.819888] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"26f65c7ffc42beac915e91bf","created_at":"2026-08-12T13:13:01.457Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68b8b63c825c4002dd0202447955b883","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.460Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-26f65c7ffc42beac915e91bf: start","job_status":"start","queue_duration_s":1.056337,"scheduling_latency_s":1.056357}1413gitlab # [ 290.834894] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"26f65c7ffc42beac915e91bf","created_at":"2026-08-12T13:13:01.457Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"68b8b63c825c4002dd0202447955b883","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.460Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-26f65c7ffc42beac915e91bf: done: 0.013565 sec","job_status":"done","queue_duration_s":1.056337,"scheduling_latency_s":1.056357,"redis_calls":7,"redis_duration_s":0.001012,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013565,"completed_at":"2026-08-12T13:13:02.530Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 290.876065] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"cd00db8d91330a77abd71f43","created_at":"2026-08-12T13:13:01.468Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"078d408dae3b8fc0d7c2b09fb8775161","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-12T13:13:01.475Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-cd00db8d91330a77abd71f43: start","job_status":"start","queue_duration_s":1.056366,"scheduling_latency_s":1.056387}1415gitlab # [ 290.889164] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.539Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1416gitlab # [ 290.893144] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"cd00db8d91330a77abd71f43","created_at":"2026-08-12T13:13:01.468Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"078d408dae3b8fc0d7c2b09fb8775161","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-12T13:13:01.475Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-cd00db8d91330a77abd71f43: done: 0.012961 sec","job_status":"done","queue_duration_s":1.056366,"scheduling_latency_s":1.056387,"redis_calls":7,"redis_duration_s":0.000923,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012961,"completed_at":"2026-08-12T13:13:02.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 290.931944] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1158756f382661216ed4474e","created_at":"2026-08-12T13:13:01.482Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.486Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1158756f382661216ed4474e: start","job_status":"start","queue_duration_s":1.059686,"scheduling_latency_s":1.05971}1418gitlab # [ 290.945506] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.571Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1158756f382661216ed4474e","created_at":"2026-08-12T13:13:01.482Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.486Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1158756f382661216ed4474e: done: 0.02577 sec","job_status":"done","queue_duration_s":1.059686,"scheduling_latency_s":1.05971,"redis_calls":14,"redis_duration_s":0.002318,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000213,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001328,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02577,"completed_at":"2026-08-12T13:13:02.571Z","load_balancing_strategy":"primary","db_duration_s":0.001094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 290.986006] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.572Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2eccc5fa9e461bdcd908eb22","created_at":"2026-08-12T13:13:01.563Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c57e851c78724f4f4c8a79a03f0c2580","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.574Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2eccc5fa9e461bdcd908eb22: start","job_status":"start","queue_duration_s":0.998136,"scheduling_latency_s":0.998155}1420gitlab # [ 290.999815] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.592Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2eccc5fa9e461bdcd908eb22","created_at":"2026-08-12T13:13:01.563Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c57e851c78724f4f4c8a79a03f0c2580","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.574Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2eccc5fa9e461bdcd908eb22: done: 0.019115 sec","job_status":"done","queue_duration_s":0.998136,"scheduling_latency_s":0.998155,"redis_calls":7,"redis_duration_s":0.000959,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019115,"completed_at":"2026-08-12T13:13:02.591Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 291.039587] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d2390b23f3135da32da90b17","created_at":"2026-08-12T13:13:01.604Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c6ffd97625ee19a02dde30ce532593e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-12T13:13:01.613Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d2390b23f3135da32da90b17: start","job_status":"start","queue_duration_s":0.979698,"scheduling_latency_s":0.979719}1422gitlab # [ 291.052973] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.600Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1423gitlab # [ 291.056164] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d2390b23f3135da32da90b17","created_at":"2026-08-12T13:13:01.604Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c6ffd97625ee19a02dde30ce532593e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-12T13:13:01.613Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d2390b23f3135da32da90b17: done: 0.012828 sec","job_status":"done","queue_duration_s":0.979698,"scheduling_latency_s":0.979719,"redis_calls":7,"redis_duration_s":0.00099,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012828,"completed_at":"2026-08-12T13:13:02.605Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 291.095901] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ba170e3499eace1796d8bf25","created_at":"2026-08-12T13:13:01.625Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a840f5f2ae1f9f74f51d674fc7b90950","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-12T13:13:01.630Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ba170e3499eace1796d8bf25: start","job_status":"start","queue_duration_s":0.976392,"scheduling_latency_s":0.976411}1425gitlab # [ 291.109156] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ba170e3499eace1796d8bf25","created_at":"2026-08-12T13:13:01.625Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a840f5f2ae1f9f74f51d674fc7b90950","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-12T13:13:01.630Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ba170e3499eace1796d8bf25: done: 0.01988 sec","job_status":"done","queue_duration_s":0.976392,"scheduling_latency_s":0.976411,"redis_calls":7,"redis_duration_s":0.0009699999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01988,"completed_at":"2026-08-12T13:13:02.626Z","load_balancing_strategy":"primary","db_duration_s":0.001674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 291.147883] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f85dc0881981d75fda1c18a3","created_at":"2026-08-12T13:13:01.650Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d115fa933399debfe7a45c956f53ea93","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.655Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f85dc0881981d75fda1c18a3: start","job_status":"start","queue_duration_s":0.972874,"scheduling_latency_s":0.972893}1427gitlab # [ 291.162458] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.659Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f85dc0881981d75fda1c18a3","created_at":"2026-08-12T13:13:01.650Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d115fa933399debfe7a45c956f53ea93","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.655Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f85dc0881981d75fda1c18a3: done: 0.031051 sec","job_status":"done","queue_duration_s":0.972874,"scheduling_latency_s":0.972893,"redis_calls":9,"redis_duration_s":0.001352,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000643,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048592,"exclusive_lock_hold_duration_s":0.01737486,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.031051,"completed_at":"2026-08-12T13:13:02.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 291.204903] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"dfbbeda38f8e5f953fcb18c1","created_at":"2026-08-12T13:13:01.684Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b7e3b821e620aa414e0220cfa40e128","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.693Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-dfbbeda38f8e5f953fcb18c1: start","job_status":"start","queue_duration_s":0.966423,"scheduling_latency_s":0.966442}1429gitlab # [ 291.218753] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"dfbbeda38f8e5f953fcb18c1","created_at":"2026-08-12T13:13:01.684Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b7e3b821e620aa414e0220cfa40e128","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.693Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-dfbbeda38f8e5f953fcb18c1: done: 0.305822 sec","job_status":"done","queue_duration_s":0.966423,"scheduling_latency_s":0.966442,"redis_calls":562,"redis_duration_s":0.054921,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.054241,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.282414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.305822,"completed_at":"2026-08-12T13:13:02.965Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 291.258349] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.967Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1e15e3f22fd895b23c9ea6c0","created_at":"2026-08-12T13:13:01.717Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da2cfb1211210c017f33f4ff15e2c77c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.732Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1e15e3f22fd895b23c9ea6c0: start","job_status":"start","queue_duration_s":1.234775,"scheduling_latency_s":1.234803}1431gitlab # [ 291.272073] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1e15e3f22fd895b23c9ea6c0","created_at":"2026-08-12T13:13:01.717Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da2cfb1211210c017f33f4ff15e2c77c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.732Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1e15e3f22fd895b23c9ea6c0: done: 0.022041 sec","job_status":"done","queue_duration_s":1.234775,"scheduling_latency_s":1.234803,"redis_calls":7,"redis_duration_s":0.00103,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.022041,"completed_at":"2026-08-12T13:13:02.989Z","load_balancing_strategy":"primary","db_duration_s":0.006447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 291.313456] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:02.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"061465d097a3c2330509d1a7","created_at":"2026-08-12T13:13:01.746Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a24af7feb2c6a7783104108cab9c8ec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.765Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-061465d097a3c2330509d1a7: start","job_status":"start","queue_duration_s":1.224517,"scheduling_latency_s":1.22454}1433gitlab # [ 291.327557] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.001Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1434gitlab # [ 291.330785] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"061465d097a3c2330509d1a7","created_at":"2026-08-12T13:13:01.746Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a24af7feb2c6a7783104108cab9c8ec","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.765Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-061465d097a3c2330509d1a7: done: 0.017758 sec","job_status":"done","queue_duration_s":1.224517,"scheduling_latency_s":1.22454,"redis_calls":7,"redis_duration_s":0.002644,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017758,"completed_at":"2026-08-12T13:13:03.008Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 291.372062] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ad5817edff1c025415b93622","created_at":"2026-08-12T13:13:01.771Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d6fbe60df6a58f827e3b03cbe43722d","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.776Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ad5817edff1c025415b93622: start","job_status":"start","queue_duration_s":1.232885,"scheduling_latency_s":1.232905}1436gitlab # [ 291.386501] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ad5817edff1c025415b93622","created_at":"2026-08-12T13:13:01.771Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d6fbe60df6a58f827e3b03cbe43722d","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.776Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ad5817edff1c025415b93622: done: 0.022151 sec","job_status":"done","queue_duration_s":1.232885,"scheduling_latency_s":1.232905,"redis_calls":10,"redis_duration_s":0.001534,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000657,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00613836,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.022151,"completed_at":"2026-08-12T13:13:03.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002431,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1437gitlab # [ 291.430404] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"285e81d10fe0ecbdc2d2b72d","created_at":"2026-08-12T13:13:01.817Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4cece5909f75d4978b0d7db869ab52a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.821Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-285e81d10fe0ecbdc2d2b72d: start","job_status":"start","queue_duration_s":1.211286,"scheduling_latency_s":1.211307}1438gitlab # [ 291.444741] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"285e81d10fe0ecbdc2d2b72d","created_at":"2026-08-12T13:13:01.817Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-494eb6de81304563","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4cece5909f75d4978b0d7db869ab52a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:01.821Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-285e81d10fe0ecbdc2d2b72d: done: 0.015404 sec","job_status":"done","queue_duration_s":1.211286,"scheduling_latency_s":1.211307,"redis_calls":7,"redis_duration_s":0.001019,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015404,"completed_at":"2026-08-12T13:13:03.048Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 291.486705] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ae42654ceb7fbe6653bcd3d","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ae42654ceb7fbe6653bcd3d: start","job_status":"start","queue_duration_s":0.572486,"scheduling_latency_s":0.572507}1440gitlab # [ 291.499469] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ae42654ceb7fbe6653bcd3d","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ae42654ceb7fbe6653bcd3d: done: 0.015032 sec","job_status":"done","queue_duration_s":0.572486,"scheduling_latency_s":0.572507,"redis_calls":13,"redis_duration_s":0.0016849999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015032,"completed_at":"2026-08-12T13:13:03.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 291.539677] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8148fc0d5dbd338df2c3547","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8148fc0d5dbd338df2c3547: start","job_status":"start","queue_duration_s":0.588617,"scheduling_latency_s":0.588636}1442gitlab # [ 291.552591] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8148fc0d5dbd338df2c3547","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8148fc0d5dbd338df2c3547: done: 0.014337 sec","job_status":"done","queue_duration_s":0.588617,"scheduling_latency_s":0.588636,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014337,"completed_at":"2026-08-12T13:13:03.079Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 291.592364] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f64af744ce32e3b2bc01207","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f64af744ce32e3b2bc01207: start","job_status":"start","queue_duration_s":0.604043,"scheduling_latency_s":0.604062}1444gitlab # [ 291.604924] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f64af744ce32e3b2bc01207","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f64af744ce32e3b2bc01207: done: 0.014274 sec","job_status":"done","queue_duration_s":0.604043,"scheduling_latency_s":0.604062,"redis_calls":13,"redis_duration_s":0.001407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014274,"completed_at":"2026-08-12T13:13:03.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 291.644503] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e34dd6a0c442c4d014dc4fa","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e34dd6a0c442c4d014dc4fa: start","job_status":"start","queue_duration_s":0.61942,"scheduling_latency_s":0.619455}1446gitlab # [ 291.656993] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e34dd6a0c442c4d014dc4fa","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e34dd6a0c442c4d014dc4fa: done: 0.01449 sec","job_status":"done","queue_duration_s":0.61942,"scheduling_latency_s":0.619455,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01449,"completed_at":"2026-08-12T13:13:03.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 291.697587] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b71031e1400cb2114252e4c7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b71031e1400cb2114252e4c7: start","job_status":"start","queue_duration_s":0.63499,"scheduling_latency_s":0.635009}1448gitlab # [ 291.710118] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b71031e1400cb2114252e4c7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b71031e1400cb2114252e4c7: done: 0.014214 sec","job_status":"done","queue_duration_s":0.63499,"scheduling_latency_s":0.635009,"redis_calls":13,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014214,"completed_at":"2026-08-12T13:13:03.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 291.749899] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be312b268bd930f3e535a79c","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be312b268bd930f3e535a79c: start","job_status":"start","queue_duration_s":0.650315,"scheduling_latency_s":0.650334}1450gitlab # [ 291.762295] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be312b268bd930f3e535a79c","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be312b268bd930f3e535a79c: done: 0.014147 sec","job_status":"done","queue_duration_s":0.650315,"scheduling_latency_s":0.650334,"redis_calls":13,"redis_duration_s":0.0013770000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014147,"completed_at":"2026-08-12T13:13:03.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 291.802037] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"933837f624cc5a518eb50627","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-933837f624cc5a518eb50627: start","job_status":"start","queue_duration_s":0.665547,"scheduling_latency_s":0.665566}1452gitlab # [ 291.814530] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"933837f624cc5a518eb50627","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-933837f624cc5a518eb50627: done: 0.014553 sec","job_status":"done","queue_duration_s":0.665547,"scheduling_latency_s":0.665566,"redis_calls":13,"redis_duration_s":0.0016389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014553,"completed_at":"2026-08-12T13:13:03.157Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 291.854544] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"feda662518669070fd8c7f90","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-feda662518669070fd8c7f90: start","job_status":"start","queue_duration_s":0.681173,"scheduling_latency_s":0.681192}1454gitlab # [ 291.866995] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"feda662518669070fd8c7f90","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-feda662518669070fd8c7f90: done: 0.014424 sec","job_status":"done","queue_duration_s":0.681173,"scheduling_latency_s":0.681192,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014424,"completed_at":"2026-08-12T13:13:03.172Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 291.907767] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"860ac4e8ff00de7d5e21e5d0","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-860ac4e8ff00de7d5e21e5d0: start","job_status":"start","queue_duration_s":0.696664,"scheduling_latency_s":0.696684}1456gitlab # [ 291.920475] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"860ac4e8ff00de7d5e21e5d0","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-860ac4e8ff00de7d5e21e5d0: done: 0.01426 sec","job_status":"done","queue_duration_s":0.696664,"scheduling_latency_s":0.696684,"redis_calls":13,"redis_duration_s":0.001399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01426,"completed_at":"2026-08-12T13:13:03.187Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 291.960192] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10871a2a6900848806d11feb","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10871a2a6900848806d11feb: start","job_status":"start","queue_duration_s":0.712011,"scheduling_latency_s":0.712031}1458gitlab # [ 291.972332] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10871a2a6900848806d11feb","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10871a2a6900848806d11feb: done: 0.014135 sec","job_status":"done","queue_duration_s":0.712011,"scheduling_latency_s":0.712031,"redis_calls":13,"redis_duration_s":0.001392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014135,"completed_at":"2026-08-12T13:13:03.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 292.012093] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"314de944a4478ba5176c7993","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-314de944a4478ba5176c7993: start","job_status":"start","queue_duration_s":0.727169,"scheduling_latency_s":0.727188}1460gitlab # [ 292.024227] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"314de944a4478ba5176c7993","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-314de944a4478ba5176c7993: done: 0.014078 sec","job_status":"done","queue_duration_s":0.727169,"scheduling_latency_s":0.727188,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014078,"completed_at":"2026-08-12T13:13:03.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 292.063616] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8aa212e5158a9442e220bf3b","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8aa212e5158a9442e220bf3b: start","job_status":"start","queue_duration_s":0.742348,"scheduling_latency_s":0.742367}1462gitlab # [ 292.076641] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8aa212e5158a9442e220bf3b","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8aa212e5158a9442e220bf3b: done: 0.014626 sec","job_status":"done","queue_duration_s":0.742348,"scheduling_latency_s":0.742367,"redis_calls":13,"redis_duration_s":0.001484,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014626,"completed_at":"2026-08-12T13:13:03.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 292.116665] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff5938cbac5b448d5ccd140b","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff5938cbac5b448d5ccd140b: start","job_status":"start","queue_duration_s":0.758097,"scheduling_latency_s":0.758116}1464gitlab # [ 292.129081] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff5938cbac5b448d5ccd140b","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff5938cbac5b448d5ccd140b: done: 0.014153 sec","job_status":"done","queue_duration_s":0.758097,"scheduling_latency_s":0.758116,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014153,"completed_at":"2026-08-12T13:13:03.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 292.168491] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7df3f6f829dc203fd46aae85","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7df3f6f829dc203fd46aae85: start","job_status":"start","queue_duration_s":0.773282,"scheduling_latency_s":0.773301}1466gitlab # [ 292.180843] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7df3f6f829dc203fd46aae85","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7df3f6f829dc203fd46aae85: done: 0.014405 sec","job_status":"done","queue_duration_s":0.773282,"scheduling_latency_s":0.773301,"redis_calls":13,"redis_duration_s":0.001642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014405,"completed_at":"2026-08-12T13:13:03.264Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 292.220308] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d43844755f327e79b6804b7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d43844755f327e79b6804b7: start","job_status":"start","queue_duration_s":0.788735,"scheduling_latency_s":0.788754}1468gitlab # [ 292.232790] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d43844755f327e79b6804b7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d43844755f327e79b6804b7: done: 0.014115 sec","job_status":"done","queue_duration_s":0.788735,"scheduling_latency_s":0.788754,"redis_calls":13,"redis_duration_s":0.001377,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014115,"completed_at":"2026-08-12T13:13:03.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 292.271966] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8590ee87a8b70b819508e2f","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8590ee87a8b70b819508e2f: start","job_status":"start","queue_duration_s":0.804017,"scheduling_latency_s":0.804036}1470gitlab # [ 292.284615] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8590ee87a8b70b819508e2f","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8590ee87a8b70b819508e2f: done: 0.014267 sec","job_status":"done","queue_duration_s":0.804017,"scheduling_latency_s":0.804036,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014267,"completed_at":"2026-08-12T13:13:03.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 292.324447] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dae72364b5cd898f2bd6af4e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dae72364b5cd898f2bd6af4e: start","job_status":"start","queue_duration_s":0.819323,"scheduling_latency_s":0.819341}1472gitlab # [ 292.336544] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dae72364b5cd898f2bd6af4e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dae72364b5cd898f2bd6af4e: done: 0.014048 sec","job_status":"done","queue_duration_s":0.819323,"scheduling_latency_s":0.819341,"redis_calls":13,"redis_duration_s":0.0013700000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014048,"completed_at":"2026-08-12T13:13:03.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 292.375704] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31b2c8fe22e5f2a9d16210da","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31b2c8fe22e5f2a9d16210da: start","job_status":"start","queue_duration_s":0.834426,"scheduling_latency_s":0.834444}1474gitlab # [ 292.388351] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31b2c8fe22e5f2a9d16210da","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31b2c8fe22e5f2a9d16210da: done: 0.014094 sec","job_status":"done","queue_duration_s":0.834426,"scheduling_latency_s":0.834444,"redis_calls":13,"redis_duration_s":0.001417,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014094,"completed_at":"2026-08-12T13:13:03.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 292.427510] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd6cd88b120805542f5afe63","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd6cd88b120805542f5afe63: start","job_status":"start","queue_duration_s":0.849555,"scheduling_latency_s":0.849573}1476gitlab # [ 292.440336] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd6cd88b120805542f5afe63","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd6cd88b120805542f5afe63: done: 0.014231 sec","job_status":"done","queue_duration_s":0.849555,"scheduling_latency_s":0.849573,"redis_calls":13,"redis_duration_s":0.00144,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014231,"completed_at":"2026-08-12T13:13:03.340Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 292.478763] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eae4d595042b330baf59acd7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eae4d595042b330baf59acd7: start","job_status":"start","queue_duration_s":0.864834,"scheduling_latency_s":0.864852}1478gitlab # [ 292.491171] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eae4d595042b330baf59acd7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eae4d595042b330baf59acd7: done: 0.014126 sec","job_status":"done","queue_duration_s":0.864834,"scheduling_latency_s":0.864852,"redis_calls":13,"redis_duration_s":0.001369,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014126,"completed_at":"2026-08-12T13:13:03.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 292.530864] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f24191998b7ed801e44ed1b","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f24191998b7ed801e44ed1b: start","job_status":"start","queue_duration_s":0.880309,"scheduling_latency_s":0.880328}1480gitlab # [ 292.543049] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f24191998b7ed801e44ed1b","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f24191998b7ed801e44ed1b: done: 0.046457 sec","job_status":"done","queue_duration_s":0.880309,"scheduling_latency_s":0.880328,"redis_calls":13,"redis_duration_s":0.0013700000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046457,"completed_at":"2026-08-12T13:13:03.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 292.581747] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"088805f4f6748ed10f90fc34","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-088805f4f6748ed10f90fc34: start","job_status":"start","queue_duration_s":0.927926,"scheduling_latency_s":0.927946}1482gitlab # [ 292.594019] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"088805f4f6748ed10f90fc34","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-088805f4f6748ed10f90fc34: done: 0.01614 sec","job_status":"done","queue_duration_s":0.927926,"scheduling_latency_s":0.927946,"redis_calls":13,"redis_duration_s":0.001626,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01614,"completed_at":"2026-08-12T13:13:03.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 292.632967] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a1e0312a60f467e49faec10","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a1e0312a60f467e49faec10: start","job_status":"start","queue_duration_s":0.945146,"scheduling_latency_s":0.945166}1484gitlab # [ 292.645198] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a1e0312a60f467e49faec10","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a1e0312a60f467e49faec10: done: 0.014153 sec","job_status":"done","queue_duration_s":0.945146,"scheduling_latency_s":0.945166,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014153,"completed_at":"2026-08-12T13:13:03.436Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 292.684356] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc0242044a73f6b08926ac44","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc0242044a73f6b08926ac44: start","job_status":"start","queue_duration_s":0.960382,"scheduling_latency_s":0.9604}1486gitlab # [ 292.696603] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc0242044a73f6b08926ac44","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc0242044a73f6b08926ac44: done: 0.014889 sec","job_status":"done","queue_duration_s":0.960382,"scheduling_latency_s":0.9604,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014889,"completed_at":"2026-08-12T13:13:03.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 292.736341] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56751526f03543a6f86907cd","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56751526f03543a6f86907cd: start","job_status":"start","queue_duration_s":0.977242,"scheduling_latency_s":0.977261}1488gitlab # [ 292.748514] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56751526f03543a6f86907cd","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56751526f03543a6f86907cd: done: 0.015566 sec","job_status":"done","queue_duration_s":0.977242,"scheduling_latency_s":0.977261,"redis_calls":13,"redis_duration_s":0.001468,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015566,"completed_at":"2026-08-12T13:13:03.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 292.787072] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2d58fb752f7b0f2559c11a8","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2d58fb752f7b0f2559c11a8: start","job_status":"start","queue_duration_s":0.993871,"scheduling_latency_s":0.993889}1490gitlab # [ 292.799242] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2d58fb752f7b0f2559c11a8","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2d58fb752f7b0f2559c11a8: done: 0.015114 sec","job_status":"done","queue_duration_s":0.993871,"scheduling_latency_s":0.993889,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015114,"completed_at":"2026-08-12T13:13:03.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 292.838049] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b66eabe87d785d536a5d19a","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b66eabe87d785d536a5d19a: start","job_status":"start","queue_duration_s":1.010055,"scheduling_latency_s":1.010074}1492gitlab # [ 292.850392] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b66eabe87d785d536a5d19a","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b66eabe87d785d536a5d19a: done: 0.015084 sec","job_status":"done","queue_duration_s":1.010055,"scheduling_latency_s":1.010074,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015084,"completed_at":"2026-08-12T13:13:03.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 292.889927] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a026d322605f9551a28b0d40","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a026d322605f9551a28b0d40: start","job_status":"start","queue_duration_s":1.026225,"scheduling_latency_s":1.026244}1494gitlab # [ 292.902425] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a026d322605f9551a28b0d40","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a026d322605f9551a28b0d40: done: 0.015828 sec","job_status":"done","queue_duration_s":1.026225,"scheduling_latency_s":1.026244,"redis_calls":13,"redis_duration_s":0.002255,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015828,"completed_at":"2026-08-12T13:13:03.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 292.943125] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10049a2845d8d4b00d0b80f7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10049a2845d8d4b00d0b80f7: start","job_status":"start","queue_duration_s":1.04313,"scheduling_latency_s":1.043149}1496gitlab # [ 292.955740] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10049a2845d8d4b00d0b80f7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10049a2845d8d4b00d0b80f7: done: 0.015044 sec","job_status":"done","queue_duration_s":1.04313,"scheduling_latency_s":1.043149,"redis_calls":13,"redis_duration_s":0.0015010000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015044,"completed_at":"2026-08-12T13:13:03.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 292.995813] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a705bc81aee02f475dfd4ff1","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a705bc81aee02f475dfd4ff1: start","job_status":"start","queue_duration_s":1.059249,"scheduling_latency_s":1.059267}1498gitlab # [ 293.008685] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a705bc81aee02f475dfd4ff1","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a705bc81aee02f475dfd4ff1: done: 0.014987 sec","job_status":"done","queue_duration_s":1.059249,"scheduling_latency_s":1.059267,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014987,"completed_at":"2026-08-12T13:13:03.551Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 293.048173] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaf799e72f4ba43ad4b1460e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaf799e72f4ba43ad4b1460e: start","job_status":"start","queue_duration_s":1.075252,"scheduling_latency_s":1.075269}1500gitlab # [ 293.060567] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaf799e72f4ba43ad4b1460e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaf799e72f4ba43ad4b1460e: done: 0.040948 sec","job_status":"done","queue_duration_s":1.075252,"scheduling_latency_s":1.075269,"redis_calls":13,"redis_duration_s":0.003646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002491,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040948,"completed_at":"2026-08-12T13:13:03.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 293.100280] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af2797864de1db41be206f97","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af2797864de1db41be206f97: start","job_status":"start","queue_duration_s":1.11928,"scheduling_latency_s":1.119325}1502gitlab # [ 293.113860] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af2797864de1db41be206f97","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af2797864de1db41be206f97: done: 0.037714 sec","job_status":"done","queue_duration_s":1.11928,"scheduling_latency_s":1.119325,"redis_calls":13,"redis_duration_s":0.003643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001291,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002352,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037714,"completed_at":"2026-08-12T13:13:03.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 293.153383] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4d389dd60baa6c1facf750e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4d389dd60baa6c1facf750e: start","job_status":"start","queue_duration_s":1.159626,"scheduling_latency_s":1.159665}1504gitlab # [ 293.165977] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4d389dd60baa6c1facf750e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4d389dd60baa6c1facf750e: done: 0.032169 sec","job_status":"done","queue_duration_s":1.159626,"scheduling_latency_s":1.159665,"redis_calls":13,"redis_duration_s":0.004184,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032169,"completed_at":"2026-08-12T13:13:03.668Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 293.205476] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee059f11ddbca4ed08a6d9c6","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee059f11ddbca4ed08a6d9c6: start","job_status":"start","queue_duration_s":1.194053,"scheduling_latency_s":1.19409}1506gitlab # [ 293.218120] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee059f11ddbca4ed08a6d9c6","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee059f11ddbca4ed08a6d9c6: done: 0.025245 sec","job_status":"done","queue_duration_s":1.194053,"scheduling_latency_s":1.19409,"redis_calls":13,"redis_duration_s":0.003117,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025245,"completed_at":"2026-08-12T13:13:03.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 293.257777] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f6f00d0e97323f85fc05700","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f6f00d0e97323f85fc05700: start","job_status":"start","queue_duration_s":1.222561,"scheduling_latency_s":1.222591}1508gitlab # [ 293.270432] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f6f00d0e97323f85fc05700","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f6f00d0e97323f85fc05700: done: 0.020063 sec","job_status":"done","queue_duration_s":1.222561,"scheduling_latency_s":1.222591,"redis_calls":13,"redis_duration_s":0.002856,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020063,"completed_at":"2026-08-12T13:13:03.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 293.310255] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"555e992b5dcb5b987c9200a7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-555e992b5dcb5b987c9200a7: start","job_status":"start","queue_duration_s":1.244211,"scheduling_latency_s":1.244233}1510gitlab # [ 293.324035] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"555e992b5dcb5b987c9200a7","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-555e992b5dcb5b987c9200a7: done: 0.017949 sec","job_status":"done","queue_duration_s":1.244211,"scheduling_latency_s":1.244233,"redis_calls":13,"redis_duration_s":0.0029040000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017949,"completed_at":"2026-08-12T13:13:03.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 293.363765] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0d7c6ea2676d3b4693a99c0","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0d7c6ea2676d3b4693a99c0: start","job_status":"start","queue_duration_s":1.263778,"scheduling_latency_s":1.263799}1512gitlab # [ 293.376664] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0d7c6ea2676d3b4693a99c0","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0d7c6ea2676d3b4693a99c0: done: 0.016822 sec","job_status":"done","queue_duration_s":1.263778,"scheduling_latency_s":1.263799,"redis_calls":13,"redis_duration_s":0.0026349999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016822,"completed_at":"2026-08-12T13:13:03.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 293.416463] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e57d9e8b39bad6026c51e6e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e57d9e8b39bad6026c51e6e: start","job_status":"start","queue_duration_s":1.281881,"scheduling_latency_s":1.281899}1514gitlab # [ 293.428968] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e57d9e8b39bad6026c51e6e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e57d9e8b39bad6026c51e6e: done: 0.017112 sec","job_status":"done","queue_duration_s":1.281881,"scheduling_latency_s":1.281899,"redis_calls":13,"redis_duration_s":0.00263,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017112,"completed_at":"2026-08-12T13:13:03.775Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 293.469046] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0fc2550da957e9554da39e5","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0fc2550da957e9554da39e5: start","job_status":"start","queue_duration_s":1.30051,"scheduling_latency_s":1.300527}1516gitlab # [ 293.481641] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0fc2550da957e9554da39e5","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0fc2550da957e9554da39e5: done: 0.016934 sec","job_status":"done","queue_duration_s":1.30051,"scheduling_latency_s":1.300527,"redis_calls":13,"redis_duration_s":0.002826,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016934,"completed_at":"2026-08-12T13:13:03.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 293.522373] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1efab96501ceb69f77c4854","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1efab96501ceb69f77c4854: start","job_status":"start","queue_duration_s":1.318772,"scheduling_latency_s":1.318788}1518gitlab # [ 293.534970] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1efab96501ceb69f77c4854","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1efab96501ceb69f77c4854: done: 0.015861 sec","job_status":"done","queue_duration_s":1.318772,"scheduling_latency_s":1.318788,"redis_calls":13,"redis_duration_s":0.002781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015861,"completed_at":"2026-08-12T13:13:03.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 293.573992] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d16248b9ba0cc1e47ce191e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d16248b9ba0cc1e47ce191e: start","job_status":"start","queue_duration_s":1.335959,"scheduling_latency_s":1.335975}1520gitlab # [ 293.586139] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d16248b9ba0cc1e47ce191e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d16248b9ba0cc1e47ce191e: done: 0.017102 sec","job_status":"done","queue_duration_s":1.335959,"scheduling_latency_s":1.335975,"redis_calls":13,"redis_duration_s":0.002751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017102,"completed_at":"2026-08-12T13:13:03.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 293.624922] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a30665ec48d91bed948cb74","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a30665ec48d91bed948cb74: start","job_status":"start","queue_duration_s":1.354787,"scheduling_latency_s":1.354805}1522gitlab # [ 293.637274] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a30665ec48d91bed948cb74","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a30665ec48d91bed948cb74: done: 0.016851 sec","job_status":"done","queue_duration_s":1.354787,"scheduling_latency_s":1.354805,"redis_calls":13,"redis_duration_s":0.002815,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001763,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016851,"completed_at":"2026-08-12T13:13:03.848Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 293.676165] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a2bfd5e3c369ca39746b315","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a2bfd5e3c369ca39746b315: start","job_status":"start","queue_duration_s":1.372959,"scheduling_latency_s":1.372976}1524gitlab # [ 293.688431] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a2bfd5e3c369ca39746b315","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a2bfd5e3c369ca39746b315: done: 0.016324 sec","job_status":"done","queue_duration_s":1.372959,"scheduling_latency_s":1.372976,"redis_calls":13,"redis_duration_s":0.0030729999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016324,"completed_at":"2026-08-12T13:13:03.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 293.728674] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd5c4d89fc28625ddd8a719","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd5c4d89fc28625ddd8a719: start","job_status":"start","queue_duration_s":1.390626,"scheduling_latency_s":1.390642}1526gitlab # [ 293.740715] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd5c4d89fc28625ddd8a719","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd5c4d89fc28625ddd8a719: done: 0.016016 sec","job_status":"done","queue_duration_s":1.390626,"scheduling_latency_s":1.390642,"redis_calls":13,"redis_duration_s":0.002601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001705,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016016,"completed_at":"2026-08-12T13:13:03.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 293.779535] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56fe356c3962b38d01c6b6d5","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56fe356c3962b38d01c6b6d5: start","job_status":"start","queue_duration_s":1.408975,"scheduling_latency_s":1.408994}1528gitlab # [ 293.792135] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56fe356c3962b38d01c6b6d5","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56fe356c3962b38d01c6b6d5: done: 0.016036 sec","job_status":"done","queue_duration_s":1.408975,"scheduling_latency_s":1.408994,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016036,"completed_at":"2026-08-12T13:13:03.901Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 293.831113] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b70821f670f25b22b7e157e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b70821f670f25b22b7e157e: start","job_status":"start","queue_duration_s":1.426596,"scheduling_latency_s":1.426615}1530gitlab # [ 293.843865] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b70821f670f25b22b7e157e","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b70821f670f25b22b7e157e: done: 0.016205 sec","job_status":"done","queue_duration_s":1.426596,"scheduling_latency_s":1.426615,"redis_calls":13,"redis_duration_s":0.002664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016205,"completed_at":"2026-08-12T13:13:03.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 293.883227] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83cb0e885a8af95493d95b16","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83cb0e885a8af95493d95b16: start","job_status":"start","queue_duration_s":1.444145,"scheduling_latency_s":1.444161}1532gitlab # [ 293.895689] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83cb0e885a8af95493d95b16","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83cb0e885a8af95493d95b16: done: 0.020644 sec","job_status":"done","queue_duration_s":1.444145,"scheduling_latency_s":1.444161,"redis_calls":13,"redis_duration_s":0.007184,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005241,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020644,"completed_at":"2026-08-12T13:13:03.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 293.936321] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68fb5f7340832f71ecef9863","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68fb5f7340832f71ecef9863: start","job_status":"start","queue_duration_s":1.466211,"scheduling_latency_s":1.466229}1534gitlab # [ 293.948342] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68fb5f7340832f71ecef9863","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68fb5f7340832f71ecef9863: done: 0.015685 sec","job_status":"done","queue_duration_s":1.466211,"scheduling_latency_s":1.466229,"redis_calls":13,"redis_duration_s":0.0026119999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015685,"completed_at":"2026-08-12T13:13:03.958Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 293.987608] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecadab8acb615dc7be0866de","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecadab8acb615dc7be0866de: start","job_status":"start","queue_duration_s":1.484042,"scheduling_latency_s":1.484059}1536gitlab # [ 294.000762] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecadab8acb615dc7be0866de","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecadab8acb615dc7be0866de: done: 0.015939 sec","job_status":"done","queue_duration_s":1.484042,"scheduling_latency_s":1.484059,"redis_calls":13,"redis_duration_s":0.002681,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001664,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015939,"completed_at":"2026-08-12T13:13:03.976Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 294.040507] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"810c88483c0c827363eaab00","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-810c88483c0c827363eaab00: start","job_status":"start","queue_duration_s":1.501301,"scheduling_latency_s":1.501318}1538gitlab # [ 294.052875] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"810c88483c0c827363eaab00","created_at":"2026-08-12T13:13:02.401Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-d535683fcc4d4445","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"09b794ac9545264f6bb3af7f77842434","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.477Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-810c88483c0c827363eaab00: done: 0.015591 sec","job_status":"done","queue_duration_s":1.501301,"scheduling_latency_s":1.501318,"redis_calls":13,"redis_duration_s":0.002533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001635,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015591,"completed_at":"2026-08-12T13:13:03.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 294.092203] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:03.995Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f16f4422eea9e32875509d93","created_at":"2026-08-12T13:13:02.557Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-52d9337896a948de","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.566Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f16f4422eea9e32875509d93: start","job_status":"start","queue_duration_s":1.428713,"scheduling_latency_s":1.428731}1540gitlab # [ 294.104559] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.008Z","message":"No existing merge request to be cleaned up."}1541gitlab # [ 294.106199] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.025Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f16f4422eea9e32875509d93","created_at":"2026-08-12T13:13:02.557Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-52d9337896a948de","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.566Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f16f4422eea9e32875509d93: done: 0.030542 sec","job_status":"done","queue_duration_s":1.428713,"scheduling_latency_s":1.428731,"redis_calls":10,"redis_duration_s":0.0024749999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001465,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030542,"completed_at":"2026-08-12T13:13:04.025Z","load_balancing_strategy":"primary","db_duration_s":0.003662,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 294.146456] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.027Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4580151c6ca8eb24d929c26b","created_at":"2026-08-12T13:13:02.557Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-52d9337896a948de","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.566Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4580151c6ca8eb24d929c26b: start","job_status":"start","queue_duration_s":1.460795,"scheduling_latency_s":1.460814}1543gitlab # [ 294.158948] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.040Z","message":"No existing merge request to be cleaned up."}1544gitlab # [ 294.160649] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.050Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4580151c6ca8eb24d929c26b","created_at":"2026-08-12T13:13:02.557Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-52d9337896a948de","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.566Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4580151c6ca8eb24d929c26b: done: 0.023162 sec","job_status":"done","queue_duration_s":1.460795,"scheduling_latency_s":1.460814,"redis_calls":10,"redis_duration_s":0.00253,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001471,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023162,"completed_at":"2026-08-12T13:13:04.050Z","load_balancing_strategy":"primary","db_duration_s":0.002786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 294.198669] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.052Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3fd99bfd5731e305039d8cc4","created_at":"2026-08-12T13:13:02.557Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-52d9337896a948de","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.566Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3fd99bfd5731e305039d8cc4: start","job_status":"start","queue_duration_s":1.485551,"scheduling_latency_s":1.485569}1546gitlab # [ 294.210650] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.065Z","message":"No existing merge request to be cleaned up."}1547gitlab # [ 294.212271] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.076Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3fd99bfd5731e305039d8cc4","created_at":"2026-08-12T13:13:02.557Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-52d9337896a948de","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.566Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3fd99bfd5731e305039d8cc4: done: 0.024109 sec","job_status":"done","queue_duration_s":1.485551,"scheduling_latency_s":1.485569,"redis_calls":10,"redis_duration_s":0.004196,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003226,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024109,"completed_at":"2026-08-12T13:13:04.076Z","load_balancing_strategy":"primary","db_duration_s":0.002732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 294.250265] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.078Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"20339f6730dee96bc156387a","created_at":"2026-08-12T13:13:02.557Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-52d9337896a948de","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.566Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-20339f6730dee96bc156387a: start","job_status":"start","queue_duration_s":1.512111,"scheduling_latency_s":1.51213}1549gitlab # [ 294.262224] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.091Z","message":"No existing merge request to be cleaned up."}1550gitlab # [ 294.263837] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:04.102Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"20339f6730dee96bc156387a","created_at":"2026-08-12T13:13:02.557Z","trace_propagation_headers":{"sentry-trace":"433e846e10224c30a8ccbf9cb1576661-52d9337896a948de","baggage":"sentry-trace_id=433e846e10224c30a8ccbf9cb1576661,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6fc995abf9688cee14480f65d6774fb0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:02.566Z","job_size_bytes":2,"pid":1984,"sidekiq_tid":"map4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-20339f6730dee96bc156387a: done: 0.023841 sec","job_status":"done","queue_duration_s":1.512111,"scheduling_latency_s":1.51213,"redis_calls":10,"redis_duration_s":0.003057,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023841,"completed_at":"2026-08-12T13:13:04.102Z","load_balancing_strategy":"primary","db_duration_s":0.002845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 307.261135] postgres[3232]: [3232] ERROR: relation "table_without_models" does not exist1552gitlab # [ 307.261627] postgres[3232]: [3232] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1553gitlab # [ 310.204420] redis[783]: 10 changes in 300 seconds. Saving...1554gitlab # [ 310.209901] redis[783]: Background saving started by pid 32671555gitlab # [ 310.215188] redis[3267]: BGSAVE done, 459 keys saved, 0 keys skipped, 118221 bytes written.1556gitlab # [ 310.219835] redis[3267]: DB saved on disk1557gitlab # [ 310.222194] redis[3267]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1558gitlab # [ 310.305522] redis[783]: Background saving terminated with success1559gitlab # [ 312.175241] postgres[857]: [857] LOG: checkpoint starting: time1560gitlab # [ 312.818791] runuser[2909]: pam_unix(runuser:session): session closed for user gitlab1561gitlab # [ 312.819721] setup-gitlab-start[2882]: + systemctl restart gitlab-sidekiq.service1562gitlab # [ 312.844999] gitaly[892]: time="2026-08-12T13:13:24.738Z" level=info msg="burden monitor stats" pid=8921563gitlab # [ 312.858629] systemd[1]: Stopping gitlab-sidekiq.service...1564gitlab # [ 312.862202] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:24.752Z","message":"Shutting down"}1565gitlab # [ 312.866363] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:24.753Z","message":"Scheduler exiting..."}1566gitlab # [ 312.870669] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:24.754Z","message":"Terminating quiet threads for default capsule"}1567gitlab # [ 312.875632] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:24.754Z","message":"Scheduler exiting..."}1568gitlab # [ 313.361914] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:25.255Z","message":"Pausing to allow jobs to finish..."}1569gitlab # [ 317.867269] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:29.760Z","message":"Bye!"}1570gitlab # [ 317.907404] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-08-12T13:13:29.801Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1984,"worker_id":"sidekiq_0","memwd_rss_bytes":955437056,"retry":0}1571gitlab # [ 318.551611] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1572gitlab # [ 318.552062] systemd[1]: Stopped gitlab-sidekiq.service.1573gitlab # [ 318.552286] systemd[1]: gitlab-sidekiq.service: Consumed 1min 50.725s CPU time over 3min 18.198s wall clock time, 949.3M memory peak, 4.5M read from disk.1574gitlab # [ 318.565279] systemd[1]: Started gitlab-sidekiq.service.1575gitlab # [ 318.569873] setup-gitlab-start[2882]: + mkdir -p /var/lib/secrets1576gitlab # [ 318.574901] setup-gitlab-start[2882]: + echo nixbot-test-token-of-20-chars1577gitlab # [ 318.577769] setup-gitlab-start[2882]: + chmod 644 /var/lib/secrets/gitlab-token1578gitlab # [ 318.580665] setup-gitlab-start[2882]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1579gitlab # [ 320.308476] gitaly[892]: time="2026-08-12T13:13:32.201Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.201" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1580gitlab # [ 320.308793] gitaly[892]: time="2026-08-12T13:13:32.202Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.201" grpc.time_ms=0.437 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1581gitlab # [ 320.542638] gitaly[892]: time="2026-08-12T13:13:32.436Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.235" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.436" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 320.560444] gitaly[892]: time="2026-08-12T13:13:32.437Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.235" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.436" grpc.time_ms=0.558 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 320.622741] gitaly[892]: time="2026-08-12T13:13:32.517Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT diskcache=d610eb3a-3d01-4b51-9ce9-45f6147cc828 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-12T13:13:42.251" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.452" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 320.644666] gitaly[892]: time="2026-08-12T13:13:32.517Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=36 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=42 command.spawn_token_fork_ms=7 command.system_time_ms=30 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-12T13:13:42.251" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.452" grpc.time_ms=64.864 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 320.666017] gitaly[892]: time="2026-08-12T13:13:32.542Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.540" pid=892 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1586gitlab # [ 320.680743] gitaly[892]: time="2026-08-12T13:13:32.542Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.540" grpc.time_ms=1.755 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 320.694029] gitaly[892]: time="2026-08-12T13:13:32.567Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-12T13:13:42.020" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.550" grpc.time_ms=16.041 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1588gitlab # [ 320.772285] gitaly[892]: time="2026-08-12T13:13:32.666Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.135" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.666" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 320.798571] gitaly[892]: time="2026-08-12T13:13:32.667Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.135" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.666" grpc.time_ms=0.667 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 320.826831] gitaly[892]: time="2026-08-12T13:13:32.706Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT diskcache=dfdcf11c-eec8-4164-b320-7ca675d7e266 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-12T13:13:42.139" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.670" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 320.846722] gitaly[892]: time="2026-08-12T13:13:32.707Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1441 command.oublock=32 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-12T13:13:42.139" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.670" grpc.time_ms=37.035 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 320.866822] gitaly[892]: time="2026-08-12T13:13:32.716Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.183" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.715" pid=892 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1593gitlab # [ 320.880820] gitaly[892]: time="2026-08-12T13:13:32.717Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.183" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.715" grpc.time_ms=1.75 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 320.898114] gitaly[892]: time="2026-08-12T13:13:32.732Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-12T13:13:42.191" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.722" grpc.time_ms=9.59 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 320.916268] gitaly[892]: time="2026-08-12T13:13:32.777Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:13:42.244" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.775" grpc.time_ms=0.757 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 320.929942] gitaly[892]: time="2026-08-12T13:13:32.786Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-12T13:13:42.255" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:32.785" grpc.time_ms=0.513 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 321.705806] gitaly[892]: time="2026-08-12T13:13:33.599Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PHM5KVDRBJEJ7EGY83WT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-12T13:13:43.051" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:33.581" grpc.time_ms=17.423 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1598gitlab # [ 322.154275] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:34 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 35451599gitlab # [ 322.160856] setup-gitlab-start[2882]: + mkdir -p /tmp/test-flake1600gitlab # [ 322.163504] setup-gitlab-start[2882]: + cd /tmp/test-flake1601gitlab # [ 322.165923] setup-gitlab-start[2882]: + git init -b master1602gitlab # [ 322.189101] setup-gitlab-start[3356]: Initialized empty Git repository in /tmp/test-flake/.git/1603gitlab # [ 322.192733] setup-gitlab-start[2882]: + git config user.name test1604gitlab # [ 322.196363] setup-gitlab-start[2882]: + git config user.email test@example.com1605gitlab # [ 322.203266] setup-gitlab-start[2882]: + cat1606gitlab # [ 322.208566] setup-gitlab-start[2882]: + git add flake.nix1607gitlab # [ 322.216747] setup-gitlab-start[2882]: + git commit -m 'initial commit'1608gitlab # [ 322.234675] setup-gitlab-start[3361]: [master (root-commit) 484f819] initial commit1609gitlab # [ 322.237491] setup-gitlab-start[3361]: 1 file changed, 10 insertions(+)1610gitlab # [ 322.239694] setup-gitlab-start[3361]: create mode 100644 flake.nix1611gitlab # [ 322.242322] setup-gitlab-start[2882]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1612gitlab # [ 322.249364] setup-gitlab-start[2882]: + git push -u origin master1613gitlab # [ 322.580358] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:34 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 2871614gitlab # [ 322.910984] gitaly[892]: time="2026-08-12T13:13:34.804Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNGCB55Y703XSQV12VBQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:34.786" grpc.time_ms=17.896 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1615gitlab # [ 322.925040] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:34 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 3301616gitlab # [ 323.307150] gitaly[892]: time="2026-08-12T13:13:35.201Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-12T13:13:45.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:35.183" grpc.time_ms=17.468 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 323.374040] gitaly[892]: time="2026-08-12T13:13:35.268Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=6 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-12T13:14:05.049" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-12T13:13:35.249" grpc.time_ms=18.417 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 323.454410] gitaly[892]: time="2026-08-12T13:13:35.348Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 duration_ms=349ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/allowed"1619gitlab # [ 323.537121] gitaly[892]: time="2026-08-12T13:13:35.431Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 duration_ms=81ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/pre_receive"1620gitlab # [ 323.548451] gitaly[892]: time="2026-08-12T13:13:35.442Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:34.997" grpc.time_ms=444.323 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1621gitlab # [ 323.635887] sidekiq-cluster[3305]: {"severity":"INFO","time":"2026-08-12T13:13:35.501Z","message":"Starting cluster with 1 processes"}1622gitlab # [ 323.641425] gitaly[892]: time="2026-08-12T13:13:35.530Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:35.528" grpc.time_ms=1.819 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1623gitlab # [ 323.726270] gitaly[892]: time="2026-08-12T13:13:35.620Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:35.619" grpc.time_ms=1.295 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1624gitlab # [ 323.812207] gitaly[892]: time="2026-08-12T13:13:35.706Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:35.705" grpc.time_ms=0.783 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 324.001993] gitaly[892]: time="2026-08-12T13:13:35.895Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-12T13:13:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:35.877" grpc.time_ms=16.917 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1626gitlab # [ 324.044300] gitaly[892]: time="2026-08-12T13:13:35.938Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-12T13:13:45.038" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:13:35.909" grpc.time_ms=29.115 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 324.082310] gitaly[892]: time="2026-08-12T13:13:35.976Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 duration_ms=222ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/post_receive"1628gitlab # [ 324.089228] gitaly[892]: time="2026-08-12T13:13:35.977Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:35.752" grpc.time_ms=225.169 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1629gitlab # [ 324.114211] gitaly[892]: time="2026-08-12T13:13:35.992Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 diskcache=4c9d285e-c611-4a47-88ed-ef5257862fdd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:34.909" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1630gitlab # [ 324.133848] setup-gitlab-start[3365]: To http://gitlab/root/test-flake.git1631gitlab # [ 324.135278] setup-gitlab-start[3365]: * [new branch] master -> master1632gitlab # [ 324.136822] setup-gitlab-start[3365]: branch 'master' set up to track 'origin/master'.1633gitlab # [ 324.138966] gitlab-workhorse[816]: time="2026-08-12T13:13:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521634gitlab # [ 324.141936] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:35 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 11641635gitlab # [ 324.145119] systemd[1]: Finished setup-gitlab.service.1636gitlab # [ 324.146166] gitaly[892]: time="2026-08-12T13:13:35.992Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=336 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13604 command.oublock=32 command.real_time_ms=1076 command.spawn_token_fork_ms=1 command.system_time_ms=198 command.user_time_ms=138 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:34.909" grpc.time_ms=1083.331 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1637gitlab # [ 324.164168] systemd[1]: Starting nixbot CI service...1638gitlab: (finished: waiting for unit setup-gitlab.service, in 325.27 seconds)1639gitlab: waiting for unit nixbot.service1640gitlab # [ 325.281471] nixbot[3460]: {"ts": "2026-08-12T13:13:37.174Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1641gitlab # [ 325.319906] nixbot[3460]: {"ts": "2026-08-12T13:13:37.214Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1642gitlab # [ 325.362515] nixbot[3460]: {"ts": "2026-08-12T13:13:37.256Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1643gitlab # [ 325.370759] nixbot[3460]: {"ts": "2026-08-12T13:13:37.264Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1644gitlab # [ 325.378225] nixbot[3460]: {"ts": "2026-08-12T13:13:37.272Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1645gitlab # [ 325.388301] nixbot[3460]: {"ts": "2026-08-12T13:13:37.282Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1646gitlab # [ 325.394728] nixbot[3460]: {"ts": "2026-08-12T13:13:37.288Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1647gitlab # [ 325.402365] nixbot[3460]: {"ts": "2026-08-12T13:13:37.292Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1648gitlab # [ 325.408568] nixbot[3460]: {"ts": "2026-08-12T13:13:37.302Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1649gitlab # [ 325.414479] nixbot[3460]: {"ts": "2026-08-12T13:13:37.306Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1650gitlab # [ 325.420596] nixbot[3460]: {"ts": "2026-08-12T13:13:37.314Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1651gitlab # [ 325.430526] nixbot[3460]: {"ts": "2026-08-12T13:13:37.324Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1652gitlab # [ 325.436314] nixbot[3460]: {"ts": "2026-08-12T13:13:37.330Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1653gitlab # [ 325.442355] nixbot[3460]: {"ts": "2026-08-12T13:13:37.333Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1654gitlab # [ 325.448390] nixbot[3460]: {"ts": "2026-08-12T13:13:37.339Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1655gitlab # [ 325.454182] nixbot[3460]: {"ts": "2026-08-12T13:13:37.342Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1656gitlab # [ 325.459506] nixbot[3460]: {"ts": "2026-08-12T13:13:37.345Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1657gitlab # [ 325.464800] nixbot[3460]: {"ts": "2026-08-12T13:13:37.347Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1658gitlab # [ 325.469688] nixbot[3460]: {"ts": "2026-08-12T13:13:37.355Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1659gitlab # [ 325.474487] nixbot[3460]: {"ts": "2026-08-12T13:13:37.357Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1660gitlab # [ 325.479388] nixbot[3460]: {"ts": "2026-08-12T13:13:37.360Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1661gitlab # [ 325.484272] nixbot[3460]: {"ts": "2026-08-12T13:13:37.368Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1662gitlab # [ 325.488874] nixbot[3460]: {"ts": "2026-08-12T13:13:37.370Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1663gitlab # [ 325.493192] nixbot[3460]: {"ts": "2026-08-12T13:13:37.373Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1664gitlab # [ 325.497086] nixbot[3460]: {"ts": "2026-08-12T13:13:37.375Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1665gitlab # [ 325.900472] nixbot[3460]: INFO: Started server process [3460]1666gitlab # [ 325.903226] nixbot[3460]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1667gitlab # [ 325.928159] nixbot[3460]: INFO: ::ffff:127.0.0.1:40116 - "GET /health HTTP/1.1" 200 OK1668gitlab # [ 325.935621] systemd[1]: Started nixbot CI service.1669gitlab # [ 325.944824] systemd[1]: Reached target Multi-User System.1670gitlab # [ 325.948488] systemd[1]: Startup finished in 745ms (kernel) + 5.215s (initrd) + 5min 19.986s (userspace) = 5min 25.948s.1671gitlab # [ 326.229122] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:38 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3051672gitlab # [ 326.231510] nixbot[3460]: {"ts": "2026-08-12T13:13:38.125Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1673gitlab # [ 326.275278] nixbot[3460]: {"ts": "2026-08-12T13:13:38.169Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1674gitlab # [ 326.378129] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 881675gitlab # [ 326.385727] nixbot[3460]: {"ts": "2026-08-12T13:13:38.274Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1676gitlab # [ 326.392711] nixbot[3460]: {"ts": "2026-08-12T13:13:38.278Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1677gitlab # [ 326.738547] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 3501678gitlab # [ 326.740843] nixbot[3460]: {"ts": "2026-08-12T13:13:38.635Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1679gitlab: (finished: waiting for unit nixbot.service, in 2.16 seconds)1680gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1681gitlab # [ 327.027320] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:38 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2711682gitlab # [ 327.036229] nixbot[3460]: {"ts": "2026-08-12T13:13:38.921Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1683gitlab # [ 327.047128] nixbot[3460]: INFO: ::ffff:127.0.0.1:40130 - "GET /health HTTP/1.1" 200 OK1684gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1685subtest: project discovered and webhook registered1686gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1687gitlab # [ 327.151559] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 901688gitlab # [ 327.156147] nixbot[3460]: {"ts": "2026-08-12T13:13:39.047Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1689gitlab # [ 327.251340] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 921690gitlab # [ 327.264900] nixbot[3460]: {"ts": "2026-08-12T13:13:39.154Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1691gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.33 seconds)1692(finished: subtest: project discovered and webhook registered, in 0.33 seconds)1693subtest: push delivers the webhook1694gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1695gitlab # [ 327.371677] gitaly[892]: time="2026-08-12T13:13:39.264Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PT3287A3N25AMMEFAFSS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-12T13:14:09.039" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:13:39.239" grpc.time_ms=24.345 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1696gitlab # [ 327.416215] gitaly[892]: time="2026-08-12T13:13:39.283Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PT3287A3N25AMMEFAFSS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:14:09.081" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:13:39.282" grpc.time_ms=1.121 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697gitlab # [ 327.440299] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 2751698gitlab # [ 327.445314] gitaly[892]: time="2026-08-12T13:13:39.296Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PT3287A3N25AMMEFAFSS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-12T13:13:49.086" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:13:39.287" grpc.time_ms=8.673 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699gitlab # [ 327.470563] nixbot[3460]: {"ts": "2026-08-12T13:13:39.336Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1700gitlab # [ 327.474712] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1631701gitlab # [ 327.537154] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 481702gitlab # [ 327.587227] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1341703gitlab # [ 327.596264] nixbot[3460]: {"ts": "2026-08-12T13:13:39.476Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1704gitlab # [ 327.599703] nixbot[3460]: {"ts": "2026-08-12T13:13:39.492Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1705gitlab # [ 327.653231] gitaly[892]: time="2026-08-12T13:13:39.547Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTBBX7JVJKBHF7A1H6P7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.534" grpc.time_ms=13.014 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1706gitlab # Enumerating objects: 5, done.1707gitlab # [ 327.687636] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1121708gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1709gitlab # Delta compression using up to 4 threads1710gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1711gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1712gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1713gitlab # [ 327.746290] gitaly[892]: time="2026-08-12T13:13:39.640Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTEY4B894T0EWEM3DTJ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.629" grpc.time_ms=10.89 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1714gitlab # [ 327.772173] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 901715gitlab # [ 327.895972] gitaly[892]: time="2026-08-12T13:13:39.790Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTHTQ2M9NNNVTYVGGH0W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.778" pid=892 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1716gitlab # [ 327.920392] gitaly[892]: time="2026-08-12T13:13:39.790Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTHTQ2M9NNNVTYVGGH0W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.778" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1717gitlab # [ 327.938225] gitlab-workhorse[816]: time="2026-08-12T13:13:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131718gitlab # [ 327.940433] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1491719gitlab # [ 327.942610] gitaly[892]: time="2026-08-12T13:13:39.805Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTHTQ2M9NNNVTYVGGH0W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.778" grpc.time_ms=12.028 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1720gitlab # [ 328.021771] gitaly[892]: time="2026-08-12T13:13:39.916Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-12T13:14:09.701" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-12T13:13:39.902" grpc.time_ms=13.717 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1721gitlab # [ 328.044096] gitaly[892]: time="2026-08-12T13:13:39.929Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTPWHSK3XSGAAMM15AW8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.910" pid=892 remote_ip="2001:db8:1::1" request_sha=c7a1e13e1d61e7023164e293b08dd5e8efa829a7 response_bytes=224 span.kind=server system=grpc1722gitlab # [ 328.063044] gitlab-workhorse[816]: time="2026-08-12T13:13:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241723gitlab # [ 328.065954] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 1261724gitlab # [ 328.068599] gitaly[892]: time="2026-08-12T13:13:39.929Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTPWHSK3XSGAAMM15AW8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.910" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1725gitlab # [ 328.086470] gitaly[892]: time="2026-08-12T13:13:39.930Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTPWHSK3XSGAAMM15AW8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.910" grpc.time_ms=20.054 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1726gitlab # [ 328.102894] gitaly[892]: time="2026-08-12T13:13:39.954Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZV1PTGJX87VB4GH66JBQH7H duration_ms=174ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/allowed"1727gitlab # [ 328.116925] gitaly[892]: time="2026-08-12T13:13:40.011Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZV1PTGJX87VB4GH66JBQH7H duration_ms=55ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/pre_receive"1728gitlab # [ 328.122088] gitaly[892]: time="2026-08-12T13:13:40.011Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:39.778" grpc.time_ms=233.574 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729gitlab # [ 328.144833] gitaly[892]: time="2026-08-12T13:13:40.039Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:40.038" grpc.time_ms=0.557 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730gitlab # [ 328.158016] gitaly[892]: time="2026-08-12T13:13:40.049Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTW8V3SMS04KCJPB6NSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.039" grpc.time_ms=10.142 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1731gitlab # [ 328.173395] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 741732gitlab # [ 328.176800] gitaly[892]: time="2026-08-12T13:13:40.071Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:40.070" grpc.time_ms=0.527 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1733gitlab # [ 328.205815] gitaly[892]: time="2026-08-12T13:13:40.100Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:40.099" grpc.time_ms=0.357 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1734gitlab # [ 328.229920] gitaly[892]: time="2026-08-12T13:13:40.124Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTYKF96W404BGG24G00M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.116" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1735gitlab # [ 328.240265] gitaly[892]: time="2026-08-12T13:13:40.124Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTYKF96W404BGG24G00M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.116" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1736gitlab # [ 328.253943] gitlab-workhorse[816]: time="2026-08-12T13:13:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671737gitlab # [ 328.255775] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 721738gitlab # [ 328.259145] gitaly[892]: time="2026-08-12T13:13:40.124Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTYKF96W404BGG24G00M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.116" grpc.time_ms=7.735 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1739gitlab # [ 328.305632] gitaly[892]: time="2026-08-12T13:13:40.200Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PV0Y2Z70ZNPCHEDE3MS8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.186" pid=892 remote_ip="2001:db8:1::1" request_sha=8b3ec9c725b72020cb000aa19d11b8d2444c8b53 response_bytes=336 span.kind=server system=grpc1740gitlab # [ 328.315779] gitaly[892]: time="2026-08-12T13:13:40.200Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PV0Y2Z70ZNPCHEDE3MS8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.186" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1741gitlab # [ 328.332366] gitlab-workhorse[816]: time="2026-08-12T13:13:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3361742gitlab # [ 328.334248] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 741743gitlab # [ 328.336364] gitaly[892]: time="2026-08-12T13:13:40.203Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PV0Y2Z70ZNPCHEDE3MS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.186" grpc.time_ms=14.101 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1744gitlab # [ 328.352389] gitaly[892]: time="2026-08-12T13:13:40.221Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZV1PTGJX87VB4GH66JBQH7H duration_ms=89ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/post_receive"1745gitlab # To http://gitlab/root/test-flake.git1746gitlab # [ 328.355222] gitaly[892]: time="2026-08-12T13:13:40.221Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:40.131" grpc.time_ms=90.266 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1747gitlab # 484f819..46730e3 [ 328.366129] gitaly[892]: time="2026-08-12T13:13:40.233Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H diskcache=e550e723-3fca-4bd3-89b9-7b2d5bdbd564 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.705" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1748gitlab # master -> master[ 328.376587] gitlab-workhorse[816]: time="2026-08-12T13:13:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521749gitlab # 1750gitlab # [ 328.378544] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:40 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6311751gitlab # [ 328.380873] gitaly[892]: time="2026-08-12T13:13:40.233Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=152 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13213 command.oublock=32 command.real_time_ms=520 command.spawn_token_fork_ms=0 command.system_time_ms=65 command.user_time_ms=87 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:39.705" grpc.time_ms=527.366 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1752gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.02 seconds)1753gitlab: must succeed: git -C /tmp/test-flake rev-parse master1754gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1755gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1756gitlab # [ 328.422682] gitaly[892]: time="2026-08-12T13:13:40.317Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PV53SQSCSPR3NWYMQ1M8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.308" grpc.time_ms=8.318 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1757gitlab # [ 328.436318] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 581758gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.10 seconds)1759gitlab # [ 328.498260] gitaly[892]: time="2026-08-12T13:13:40.392Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PV70EPPQ85A16CRF1CRQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.375" pid=892 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1760gitlab # [ 328.516694] gitaly[892]: time="2026-08-12T13:13:40.394Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PV70EPPQ85A16CRF1CRQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.375" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1761gitlab # [ 328.540843] nixbot[3460]: INFO: ::ffff:127.0.0.1:40132 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1762gitlab # [ 328.543758] gitlab-workhorse[816]: time="2026-08-12T13:13:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091763gitlab # [ 328.546602] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 751764gitlab # [ 328.549342] gitaly[892]: time="2026-08-12T13:13:40.394Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PV70EPPQ85A16CRF1CRQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:40.375" grpc.time_ms=19.33 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1765gitlab # [ 328.605102] gitaly[892]: time="2026-08-12T13:13:40.499Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:14:10.297" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:13:40.498" grpc.time_ms=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 328.674228] gitaly[892]: time="2026-08-12T13:13:40.568Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-12T13:14:10.352" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:13:40.553" grpc.time_ms=15.133 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 328.720987] gitaly[892]: time="2026-08-12T13:13:40.615Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:13:50.068" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:13:40.598" grpc.time_ms=16.646 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 328.759065] gitaly[892]: time="2026-08-12T13:13:40.653Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:13:50.106" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:13:40.636" grpc.time_ms=16.627 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 328.883072] gitaly[892]: time="2026-08-12T13:13:40.777Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-12T13:13:50.246" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:40.776" grpc.time_ms=0.55 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 328.916457] gitaly[892]: time="2026-08-12T13:13:40.806Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-12T13:13:50.260" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:13:40.791" grpc.time_ms=14.658 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 328.986480] gitaly[892]: time="2026-08-12T13:13:40.880Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:40.879" grpc.time_ms=1.157 pid=892 span.kind=server system=grpc1772gitlab # [ 329.034279] gitaly[892]: time="2026-08-12T13:13:40.928Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:13:40.926" grpc.time_ms=2.227 pid=892 span.kind=server system=grpc1773gitlab # [ 329.063415] gitaly[892]: time="2026-08-12T13:13:40.941Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N diskcache=11b366e2-baa1-4d61-84b8-4d4dbeca671b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-12T13:13:50.280" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:40.811" pid=892 ref=refs/keep-around/484f819f5adc66debce15e67fdd30cc44132c6dd remote_ip="2001:db8:1::1" revision=484f819f5adc66debce15e67fdd30cc44132c6dd span.kind=server system=grpc username=root1774gitlab # [ 329.091065] gitaly[892]: time="2026-08-12T13:13:40.941Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=125 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5283 command.oublock=8 command.real_time_ms=122 command.spawn_token_fork_ms=2 command.system_time_ms=67 command.user_time_ms=58 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-12T13:13:50.280" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:13:40.811" grpc.time_ms=129.834 pid=892 ref=refs/keep-around/484f819f5adc66debce15e67fdd30cc44132c6dd remote_ip="2001:db8:1::1" revision=484f819f5adc66debce15e67fdd30cc44132c6dd span.kind=server system=grpc username=root1775gitlab # [ 329.118002] gitaly[892]: time="2026-08-12T13:13:40.948Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:14:10.746" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:13:40.947" grpc.time_ms=0.857 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 329.384864] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 8371777gitlab # [ 329.390880] nixbot[3460]: {"ts": "2026-08-12T13:13:41.280Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd \"HTTP/1.1 201 Created\""}1778gitlab # [ 329.403241] nixbot[3460]: {"ts": "2026-08-12T13:13:41.297Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-484f819f5adc-0"}1779gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1780gitlab # [ 329.516132] systemd[1]: Started Nix Daemon.1781gitlab # [ 329.569126] nixbot[3460]: INFO: ::ffff:127.0.0.1:40144 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1782gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1783gitlab # [ 329.628652] nix-daemon[3669]: accepted connection from pid 3663, user nixbot1784gitlab # [ 329.765120] nix-daemon[3669]: accepted connection from pid 3679, user nixbot1785gitlab # [ 329.789937] nixbot[3460]: {"ts": "2026-08-12T13:13:41.684Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-484f819f5adc-0", "argv0": "bwrap"}1786gitlab # [ 330.014019] nix-daemon[3669]: accepted connection from pid 3689, user nixbot1787gitlab # [ 330.081768] nix-daemon[3669]: accepted connection from pid 3699, user nixbot1788gitlab # [ 330.253923] gitaly[892]: time="2026-08-12T13:13:42.147Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PWWF6X7WXB2R9F5QBQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:14:12.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:13:42.145" grpc.time_ms=1.279 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 330.332919] gitaly[892]: time="2026-08-12T13:13:42.227Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PWWF6X7WXB2R9F5QBQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:13:52.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:13:42.208" grpc.time_ms=17.977 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 330.481846] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3431791gitlab # [ 330.491341] nixbot[3460]: {"ts": "2026-08-12T13:13:42.377Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd \"HTTP/1.1 201 Created\""}1792gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1793gitlab # [ 330.577903] gitaly[892]: time="2026-08-12T13:13:42.472Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PX7G0DFMHNAKERE5H3XR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:14:12.270" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:13:42.470" grpc.time_ms=1.235 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 330.632719] nixbot[3460]: INFO: ::ffff:127.0.0.1:40150 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1795gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.07 seconds)1796gitlab # [ 330.660770] gitaly[892]: time="2026-08-12T13:13:42.555Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PX7G0DFMHNAKERE5H3XR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:13:52.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:13:42.538" grpc.time_ms=16.522 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 330.766453] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2751798gitlab # [ 330.774533] nixbot[3460]: {"ts": "2026-08-12T13:13:42.662Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd \"HTTP/1.1 201 Created\""}1799gitlab # [ 330.916459] gitaly[892]: time="2026-08-12T13:13:42.810Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PXGT1NXKERHJKCTJ8EYK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:14:12.607" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:13:42.809" grpc.time_ms=1.309 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 331.405436] gitaly[892]: time="2026-08-12T13:13:43.298Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PXGT1NXKERHJKCTJ8EYK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:13:53.100" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:13:43.281" grpc.time_ms=17.089 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 331.540442] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 7501802gitlab # [ 331.548489] nixbot[3460]: {"ts": "2026-08-12T13:13:43.434Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd \"HTTP/1.1 201 Created\""}1803gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1804gitlab # [ 331.692808] nixbot[3460]: INFO: ::ffff:127.0.0.1:60114 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1805gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1806gitlab # [ 331.700310] nix-daemon[3669]: accepted connection from pid 3722, user nixbot1807gitlab # [ 331.922443] gitaly[892]: time="2026-08-12T13:13:43.816Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PYG9RYPC1PWSMK43Z60M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:43.799" grpc.time_ms=17.494 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1808gitlab # [ 331.963425] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1281809gitlab # [ 332.081816] gitaly[892]: time="2026-08-12T13:13:43.976Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PYMCEM3PT9V91DMTX7AP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:43.957" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1810gitlab # [ 332.114936] gitaly[892]: time="2026-08-12T13:13:43.976Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PYMCEM3PT9V91DMTX7AP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:43.957" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1811gitlab # [ 332.142135] gitlab-workhorse[816]: time="2026-08-12T13:13:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671812gitlab # [ 332.145223] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:13:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1561813gitlab # [ 332.148162] gitaly[892]: time="2026-08-12T13:13:43.976Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PYMCEM3PT9V91DMTX7AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:13:43.957" grpc.time_ms=19.547 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1814gitlab # [ 332.262511] nix-daemon[3669]: accepted connection from pid 3750, user nixbot1815gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1816gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1817gitlab # [ 332.751080] nixbot[3460]: INFO: ::ffff:127.0.0.1:60124 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1818gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1819gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1820gitlab # [ 333.803247] nixbot[3460]: INFO: ::ffff:127.0.0.1:60128 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1821gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1823gitlab # [ 334.857750] nixbot[3460]: INFO: ::ffff:127.0.0.1:60142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1824gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1825gitlab # [ 335.911246] nixbot[3460]: INFO: ::ffff:127.0.0.1:60158 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1826gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1827gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1829gitlab # [ 336.965699] nixbot[3460]: INFO: ::ffff:127.0.0.1:60160 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1830gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1832gitlab # [ 338.018203] nixbot[3460]: INFO: ::ffff:127.0.0.1:60168 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1833gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1834gitlab # [ 339.070969] nixbot[3460]: INFO: ::ffff:127.0.0.1:60170 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1835gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1836gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1837gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1838gitlab # [ 340.125668] nixbot[3460]: INFO: ::ffff:127.0.0.1:60176 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1839gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1840gitlab # [ 341.177855] nixbot[3460]: INFO: ::ffff:127.0.0.1:57966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1841gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1844gitlab # [ 342.231431] nixbot[3460]: INFO: ::ffff:127.0.0.1:57968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1845gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1846gitlab # [ 343.284419] nixbot[3460]: INFO: ::ffff:127.0.0.1:57976 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1847gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1848gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1849gitlab # [ 344.339961] nixbot[3460]: INFO: ::ffff:127.0.0.1:57986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1850gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1851gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1852gitlab # [ 345.394619] nixbot[3460]: INFO: ::ffff:127.0.0.1:57996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1853gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1854gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1855gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1856gitlab # [ 346.448765] nixbot[3460]: INFO: ::ffff:127.0.0.1:58006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1857gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1858gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1859gitlab # [ 347.501857] nixbot[3460]: INFO: ::ffff:127.0.0.1:58022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1860gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1861gitlab # [ 348.554205] nixbot[3460]: INFO: ::ffff:127.0.0.1:58026 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1862gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1863gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1865gitlab # [ 349.608440] nixbot[3460]: INFO: ::ffff:127.0.0.1:58030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1866gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1867gitlab # [ 350.661889] nixbot[3460]: INFO: ::ffff:127.0.0.1:58044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1868gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1869gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1870gitlab # [ 351.717470] nixbot[3460]: INFO: ::ffff:127.0.0.1:46076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1871gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1872gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1874gitlab # [ 352.771174] nixbot[3460]: INFO: ::ffff:127.0.0.1:46090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1875gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1876gitlab # [ 353.822881] nixbot[3460]: INFO: ::ffff:127.0.0.1:46104 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1877gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1878gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1879gitlab # [ 354.877810] nixbot[3460]: INFO: ::ffff:127.0.0.1:46116 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1880gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1881gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1882gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1883gitlab # [ 355.933800] nixbot[3460]: INFO: ::ffff:127.0.0.1:46126 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1884gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1885gitlab # [ 356.985934] nixbot[3460]: INFO: ::ffff:127.0.0.1:46134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1886gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1887gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1888gitlab # [ 358.040416] nixbot[3460]: INFO: ::ffff:127.0.0.1:46150 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1889gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1891gitlab # [ 359.094795] nixbot[3460]: INFO: ::ffff:127.0.0.1:46156 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1894gitlab # [ 360.149322] nixbot[3460]: INFO: ::ffff:127.0.0.1:46168 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1895gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1896gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1897gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1898gitlab # [ 361.203920] nixbot[3460]: INFO: ::ffff:127.0.0.1:33722 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1899gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1900gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1901gitlab # [ 362.256746] nixbot[3460]: INFO: ::ffff:127.0.0.1:33728 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1902gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1903gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.03 seconds)1904gitlab # [ 363.291807] nixbot[3460]: INFO: ::ffff:127.0.0.1:33744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1905gitlab # [ 363.530617] sidekiq-cluster[3421]: 2026-08-12T13:14:15.423Z pid=3421 tid=yr9 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3421, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434282496}1906gitlab # [ 363.823556] sidekiq-cluster[3421]: W, [2026-08-12T13:14:15.717881 #3421] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1907gitlab # [ 363.889371] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:14:15.783Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1908gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1909gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1910gitlab # [ 364.342683] nixbot[3460]: INFO: ::ffff:127.0.0.1:33758 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1911gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1912gitlab # [ 365.396430] nixbot[3460]: INFO: ::ffff:127.0.0.1:33770 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1914gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1915gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1916gitlab # [ 366.451277] nixbot[3460]: INFO: ::ffff:127.0.0.1:33786 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1917gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1918gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1919gitlab # [ 367.503281] nixbot[3460]: INFO: ::ffff:127.0.0.1:33794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1920gitlab # [ 367.530727] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:14:19.424Z","message":"GitLab reliable fetch activated!"}1921gitlab # [ 367.535518] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:14:19.424Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1922gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1923gitlab # [ 368.556171] nixbot[3460]: INFO: ::ffff:127.0.0.1:33810 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1924gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1925gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1927gitlab # [ 369.610009] nixbot[3460]: INFO: ::ffff:127.0.0.1:33822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1928gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1929gitlab # [ 370.661336] nixbot[3460]: INFO: ::ffff:127.0.0.1:33832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1931gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1932gitlab # [ 371.714911] nixbot[3460]: INFO: ::ffff:127.0.0.1:39276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1933gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1934gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1935gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1936gitlab # [ 372.769499] nixbot[3460]: INFO: ::ffff:127.0.0.1:39282 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1937gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1939gitlab # [ 373.821628] nixbot[3460]: INFO: ::ffff:127.0.0.1:39296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1940gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1941gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1942gitlab # [ 374.873933] nixbot[3460]: INFO: ::ffff:127.0.0.1:39304 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1943gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1944gitlab # [ 375.925528] nixbot[3460]: INFO: ::ffff:127.0.0.1:39308 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1945gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1946gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1947gitlab # [ 376.980717] nixbot[3460]: INFO: ::ffff:127.0.0.1:39316 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1948gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1949gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1950gitlab # [ 378.035722] nixbot[3460]: INFO: ::ffff:127.0.0.1:39326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1951gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1953gitlab # [ 379.090310] nixbot[3460]: INFO: ::ffff:127.0.0.1:39330 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1955gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1956gitlab # [ 380.144583] nixbot[3460]: INFO: ::ffff:127.0.0.1:39342 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1957gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1958gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1960gitlab # [ 381.198911] nixbot[3460]: INFO: ::ffff:127.0.0.1:43878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1961gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1963gitlab # [ 382.251488] nixbot[3460]: INFO: ::ffff:127.0.0.1:43892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1964gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1965gitlab # [ 383.302829] nixbot[3460]: INFO: ::ffff:127.0.0.1:43898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1966gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1967gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1969gitlab # [ 384.357297] nixbot[3460]: INFO: ::ffff:127.0.0.1:43902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1972gitlab # [ 385.408641] nixbot[3460]: INFO: ::ffff:127.0.0.1:43904 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1973gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1974gitlab # [ 386.461688] nixbot[3460]: INFO: ::ffff:127.0.0.1:43918 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1977gitlab # [ 387.517139] nixbot[3460]: INFO: ::ffff:127.0.0.1:43924 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1978gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1979gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1980gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1981gitlab # [ 388.572091] nixbot[3460]: INFO: ::ffff:127.0.0.1:43932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1983gitlab # [ 389.623798] nixbot[3460]: INFO: ::ffff:127.0.0.1:43948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1984gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1985gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1986gitlab # [ 390.678518] nixbot[3460]: INFO: ::ffff:127.0.0.1:43954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1989gitlab # [ 391.732663] nixbot[3460]: INFO: ::ffff:127.0.0.1:52802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1990gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1992gitlab # [ 392.787111] nixbot[3460]: INFO: ::ffff:127.0.0.1:52812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1993gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1995gitlab # [ 393.842154] nixbot[3460]: INFO: ::ffff:127.0.0.1:52822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'1998gitlab # [ 394.898535] nixbot[3460]: INFO: ::ffff:127.0.0.1:52838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK1999gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2001gitlab # [ 395.953047] nixbot[3460]: INFO: ::ffff:127.0.0.1:52854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2004gitlab # [ 397.007225] nixbot[3460]: INFO: ::ffff:127.0.0.1:52858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2005gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2008gitlab # [ 398.061914] nixbot[3460]: INFO: ::ffff:127.0.0.1:52872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2010gitlab # [ 399.114311] nixbot[3460]: INFO: ::ffff:127.0.0.1:52888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2011gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2014gitlab # [ 400.169593] nixbot[3460]: INFO: ::ffff:127.0.0.1:52904 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2016gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2017gitlab # [ 401.219835] nixbot[3460]: INFO: ::ffff:127.0.0.1:43006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2018gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2019gitlab # [ 402.273096] nixbot[3460]: INFO: ::ffff:127.0.0.1:43008 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2020gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2022gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2023gitlab # [ 403.326528] nixbot[3460]: INFO: ::ffff:127.0.0.1:43016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2025gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2026gitlab # [ 404.377862] nixbot[3460]: INFO: ::ffff:127.0.0.1:43018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2027gitlab # [ 405.249239] postgres[3984]: [3984] ERROR: relation "table_without_models" does not exist2028gitlab # [ 405.252510] postgres[3984]: [3984] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2030gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2031gitlab # [ 405.430984] nixbot[3460]: INFO: ::ffff:127.0.0.1:43034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2032gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2033gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2034gitlab # [ 406.482830] nixbot[3460]: INFO: ::ffff:127.0.0.1:43048 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2035gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2036gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2037gitlab # [ 407.535129] nixbot[3460]: INFO: ::ffff:127.0.0.1:43054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2038gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2039gitlab # [ 408.587569] nixbot[3460]: INFO: ::ffff:127.0.0.1:43066 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2040gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2041gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2042gitlab # [ 409.642249] nixbot[3460]: INFO: ::ffff:127.0.0.1:43082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2044gitlab # [ 410.095932] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:01.987Z","message":"Booted Rails 7.2.3.1 application in production environment"}2045gitlab # [ 410.101493] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:01.995Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2046gitlab # [ 410.103491] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:01.995Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2047gitlab # [ 410.105316] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:01.995Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2048gitlab # [ 410.107938] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:02.002Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2049gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2050gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2051gitlab # [ 410.698809] nixbot[3460]: INFO: ::ffff:127.0.0.1:43088 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2052gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2054gitlab # [ 411.750956] nixbot[3460]: INFO: ::ffff:127.0.0.1:50060 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2055gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2056gitlab # [ 412.826261] nixbot[3460]: INFO: ::ffff:127.0.0.1:50072 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2057gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.08 seconds)2058gitlab # [ 412.829129] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:04.721Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6c4df766c6ef2d8f329e024c","created_at":"2026-08-12T13:13:32.585Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:32.635Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6c4df766c6ef2d8f329e024c: start","job_status":"start","queue_duration_s":92.08577,"scheduling_latency_s":92.085868}2059gitlab # [ 413.202463] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.095Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6c4df766c6ef2d8f329e024c","created_at":"2026-08-12T13:13:32.585Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:32.635Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6c4df766c6ef2d8f329e024c: done: 0.374826 sec","job_status":"done","queue_duration_s":92.08577,"scheduling_latency_s":92.085868,"redis_calls":23,"redis_duration_s":0.011696,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.006111,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00341,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002175,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.198836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19462524,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.374826,"completed_at":"2026-08-12T13:15:05.095Z","load_balancing_strategy":"primary","db_duration_s":0.103603,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2060gitlab # [ 413.322302] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.099Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"a9a7a71728309038472d8508","created_at":"2026-08-12T13:13:32.651Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:32.659Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-a9a7a71728309038472d8508: start","job_status":"start","queue_duration_s":92.439727,"scheduling_latency_s":92.439767}2061gitlab # [ 413.386740] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.280Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"a9a7a71728309038472d8508","created_at":"2026-08-12T13:13:32.651Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:32.659Z","job_size_bytes":2,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-a9a7a71728309038472d8508: done: 0.181509 sec","job_status":"done","queue_duration_s":92.439727,"scheduling_latency_s":92.439767,"redis_calls":14,"redis_duration_s":0.005074,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001029,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002424,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001621,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.133677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13845126000000002,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.181509,"completed_at":"2026-08-12T13:15:05.280Z","load_balancing_strategy":"primary","db_duration_s":0.036886,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2062gitlab # [ 413.488294] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.283Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"17eb8c3694b2518ce6a7c9f0","created_at":"2026-08-12T13:13:33.366Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:33.383Z","job_size_bytes":5,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-17eb8c3694b2518ce6a7c9f0: start","job_status":"start","queue_duration_s":91.899564,"scheduling_latency_s":91.89959}2063gitlab # [ 413.662918] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.556Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"17eb8c3694b2518ce6a7c9f0","created_at":"2026-08-12T13:13:33.366Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:33.383Z","job_size_bytes":5,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-17eb8c3694b2518ce6a7c9f0: done: 0.273397 sec","job_status":"done","queue_duration_s":91.899564,"scheduling_latency_s":91.89959,"redis_calls":12,"redis_duration_s":0.003983,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000894,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002445,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.222084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064282,"duration_s":0.273397,"completed_at":"2026-08-12T13:15:05.556Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042945,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2064gitlab # [ 413.759471] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.558Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9da1c0c106c5cac8106a5af9","created_at":"2026-08-12T13:13:33.450Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:33.463Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9da1c0c106c5cac8106a5af9: start","job_status":"start","queue_duration_s":92.095731,"scheduling_latency_s":92.095759}2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2066gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)2067gitlab # [ 413.888270] nixbot[3460]: INFO: ::ffff:127.0.0.1:50076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2068gitlab # [ 414.033213] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.925Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9da1c0c106c5cac8106a5af9","created_at":"2026-08-12T13:13:33.450Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:33.463Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9da1c0c106c5cac8106a5af9: done: 0.366286 sec","job_status":"done","queue_duration_s":92.095731,"scheduling_latency_s":92.095759,"redis_calls":11,"redis_duration_s":0.003849,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000789,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002363,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000697,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.308,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.308,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.259709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00081794,"duration_s":0.366286,"completed_at":"2026-08-12T13:15:05.925Z","load_balancing_strategy":"primary","db_duration_s":0.110946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2069gitlab # [ 414.128358] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.928Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"cb1045fd4bda4fe0b0d92ab5","created_at":"2026-08-12T13:13:33.471Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:33.482Z","job_size_bytes":89,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-cb1045fd4bda4fe0b0d92ab5: start","job_status":"start","queue_duration_s":92.445968,"scheduling_latency_s":92.446002}2070gitlab # [ 414.149063] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.994Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"cb1045fd4bda4fe0b0d92ab5","created_at":"2026-08-12T13:13:33.471Z","trace_propagation_headers":{"sentry-trace":"c0a4f5b9ed7240c191dccb3150fcb1d9-33986abafeb744cb","baggage":"sentry-trace_id=c0a4f5b9ed7240c191dccb3150fcb1d9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PHM5KVDRBJEJ7EGY83WT","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:33.482Z","job_size_bytes":89,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-cb1045fd4bda4fe0b0d92ab5: done: 0.066189 sec","job_status":"done","queue_duration_s":92.445968,"scheduling_latency_s":92.446002,"redis_calls":11,"redis_duration_s":0.003921,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001128,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000699,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007035,"duration_s":0.066189,"completed_at":"2026-08-12T13:15:05.994Z","load_balancing_strategy":"primary","db_duration_s":0.009973,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2071gitlab # [ 414.232224] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:05.997Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 484f819f5adc66debce15e67fdd30cc44132c6dd refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"072b5b9bc68e850a2d7404ca","created_at":"2026-08-12T13:13:35.834Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-f424e590c75348de","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:35.845Z","job_size_bytes":185,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-072b5b9bc68e850a2d7404ca: start","job_status":"start","queue_duration_s":90.151717,"scheduling_latency_s":90.151745}2072gitlab # [ 414.268425] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:06.022Z","message":"changes: \"0000000000000000000000000000000000000000 484f819f5adc66debce15e67fdd30cc44132c6dd refs/heads/master\\n\""}2073gitlab # [ 414.273907] gitaly[892]: time="2026-08-12T13:15:06.072Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:16.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:06.061" grpc.time_ms=10.196 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 414.295027] gitaly[892]: time="2026-08-12T13:15:06.095Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-12T13:15:16.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:06.083" grpc.time_ms=11.945 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075gitlab # [ 414.312348] gitaly[892]: time="2026-08-12T13:15:06.174Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=7 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-12T13:15:16.094" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:06.155" grpc.time_ms=18.874 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 414.333110] gitaly[892]: time="2026-08-12T13:15:06.227Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:06.225" grpc.time_ms=1.515 pid=892 span.kind=server system=grpc2077gitlab # [ 414.385467] gitaly[892]: time="2026-08-12T13:15:06.279Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:06.279" grpc.time_ms=0.641 pid=892 span.kind=server system=grpc2078gitlab # [ 414.409493] gitaly[892]: time="2026-08-12T13:15:06.293Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 diskcache=5c71c431-ef7e-4fca-af44-fa3ffc47622c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-12T13:15:16.127" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:06.187" pid=892 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2079gitlab # [ 414.428983] gitaly[892]: time="2026-08-12T13:15:06.294Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=114 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4957 command.oublock=8 command.real_time_ms=99 command.spawn_token_fork_ms=1 command.system_time_ms=82 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-12T13:15:16.127" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:06.187" grpc.time_ms=106.338 pid=892 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2080gitlab # [ 414.451446] gitaly[892]: time="2026-08-12T13:15:06.321Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-12T13:15:16.260" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:06.321" grpc.time_ms=0.329 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081gitlab # [ 414.468386] gitaly[892]: time="2026-08-12T13:15:06.351Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=861 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-12T13:15:16.267" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:06.327" grpc.time_ms=23.897 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 414.612831] gitaly[892]: time="2026-08-12T13:15:06.506Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-12T13:15:36.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:06.495" grpc.time_ms=11.674 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 414.669317] gitaly[892]: time="2026-08-12T13:15:06.563Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-12T13:15:16.002" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:06.562" grpc.time_ms=0.57 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 414.698717] gitaly[892]: time="2026-08-12T13:15:06.579Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-12T13:15:16.007" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-12T13:15:06.567" grpc.time_ms=11.242 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 414.728082] gitaly[892]: time="2026-08-12T13:15:06.622Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:16.044" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:06.604" grpc.time_ms=17.534 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 414.754929] gitaly[892]: time="2026-08-12T13:15:06.649Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:16.071" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:06.632" grpc.time_ms=17.285 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 414.804855] gitaly[892]: time="2026-08-12T13:15:06.699Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-12T13:15:36.271" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:06.671" grpc.time_ms=27.114 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2089gitlab # [ 414.953047] nixbot[3460]: INFO: ::ffff:127.0.0.1:50086 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2090gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.07 seconds)2091gitlab # [ 415.416274] gitaly[892]: time="2026-08-12T13:15:07.309Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-12T13:15:17.246" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:07.306" grpc.time_ms=2.648 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab # [ 415.458394] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:07.351Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 484f819f5adc66debce15e67fdd30cc44132c6dd refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"072b5b9bc68e850a2d7404ca","created_at":"2026-08-12T13:13:35.834Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-f424e590c75348de","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:35.845Z","job_size_bytes":185,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-072b5b9bc68e850a2d7404ca: done: 1.354063 sec","job_status":"done","queue_duration_s":90.151717,"scheduling_latency_s":90.151745,"gitaly_calls":13,"gitaly_duration_s":0.314952,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.067815,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.006377,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.007954,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002016,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006107,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.027317,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.018044,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.33,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.375,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.087,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.884799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00087488,"exclusive_lock_hold_duration_s":0.03876988,"duration_s":1.354063,"completed_at":"2026-08-12T13:15:07.351Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.154999,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2093gitlab # [ 415.553349] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:07.354Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","484f819f5adc66debce15e67fdd30cc44132c6dd 46730e36718dbbe0d5197aec6d0ce676ee7b68cb refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4fab321fe4326697890b51e0","created_at":"2026-08-12T13:13:40.174Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-6b917cd9a0774eb1","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:40.179Z","job_size_bytes":185,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4fab321fe4326697890b51e0: start","job_status":"start","queue_duration_s":87.174788,"scheduling_latency_s":87.174813}2094gitlab # [ 415.571565] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:07.368Z","message":"changes: \"484f819f5adc66debce15e67fdd30cc44132c6dd 46730e36718dbbe0d5197aec6d0ce676ee7b68cb refs/heads/master\\n\""}2095gitlab # [ 415.574146] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:07.428Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d5e592e23c167ce653f3b87d","created_at":"2026-08-12T13:15:07.426Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-7d66f86c4c0d4e82","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"8417b3ad99509af4ea626236","job_size_bytes":46,"pid":3421,"job_status":"deduplicated","message":"ProjectCacheWorker JID-d5e592e23c167ce653f3b87d: deduplicated: until executing","deduplication.type":"until executing"}2096gitlab # [ 415.588685] gitaly[892]: time="2026-08-12T13:15:07.402Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:17.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:07.388" grpc.time_ms=13.844 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 415.601655] gitaly[892]: time="2026-08-12T13:15:07.423Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-12T13:15:17.026" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:07.407" grpc.time_ms=16.286 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 415.614928] gitaly[892]: time="2026-08-12T13:15:07.459Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-12T13:15:17.062" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:07.442" grpc.time_ms=16.475 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 415.628360] gitaly[892]: time="2026-08-12T13:15:07.483Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-12T13:15:37.067" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:07.468" grpc.time_ms=15.174 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 415.643234] gitaly[892]: time="2026-08-12T13:15:07.508Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-12T13:15:17.116" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-12T13:15:07.497" grpc.time_ms=11.659 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 415.656690] gitaly[892]: time="2026-08-12T13:15:07.543Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:17.147" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:07.527" grpc.time_ms=15.703 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2103gitlab # [ 415.956656] gitaly[892]: time="2026-08-12T13:15:07.851Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-12T13:15:17.148" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:07.708" grpc.time_ms=142.288 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.06 seconds)2105gitlab # [ 415.996091] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:07.888Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","484f819f5adc66debce15e67fdd30cc44132c6dd 46730e36718dbbe0d5197aec6d0ce676ee7b68cb refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4fab321fe4326697890b51e0","created_at":"2026-08-12T13:13:40.174Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-6b917cd9a0774eb1","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-12T13:13:40.179Z","job_size_bytes":185,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4fab321fe4326697890b51e0: done: 0.5345 sec","job_status":"done","queue_duration_s":87.174788,"scheduling_latency_s":87.174813,"gitaly_calls":7,"gitaly_duration_s":0.255808,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.032568,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003774,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001403,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004258,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.00937,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013763,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.042,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.042,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.368343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00085566,"exclusive_lock_hold_duration_s":0.024025,"duration_s":0.5345,"completed_at":"2026-08-12T13:15:07.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040946,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2106gitlab # [ 416.053228] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:07.897Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a631fb6e67d208b31bf69a3f","created_at":"2026-08-12T13:13:40.957Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-a7cd2089aaba4a44","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:40.972Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a631fb6e67d208b31bf69a3f: start","job_status":"start","queue_duration_s":86.925127,"scheduling_latency_s":86.925182}2107gitlab # [ 416.070298] nixbot[3460]: INFO: ::ffff:127.0.0.1:50088 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2108gitlab # [ 416.198888] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:08.091Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"a631fb6e67d208b31bf69a3f","created_at":"2026-08-12T13:13:40.957Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-a7cd2089aaba4a44","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:40.972Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-a631fb6e67d208b31bf69a3f: done: 0.194091 sec","job_status":"done","queue_duration_s":86.925127,"scheduling_latency_s":86.925182,"redis_calls":16,"redis_duration_s":0.008182,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.004477,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.138675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00085798,"duration_s":0.194091,"completed_at":"2026-08-12T13:15:08.091Z","load_balancing_strategy":"primary","db_duration_s":0.040207,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2109gitlab # [ 416.292575] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:08.095Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e5fdb2263252433dcdab21c0","created_at":"2026-08-12T13:13:40.973Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-a7cd2089aaba4a44","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:40.986Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e5fdb2263252433dcdab21c0: start","job_status":"start","queue_duration_s":87.109248,"scheduling_latency_s":87.109288}2110gitlab # [ 416.401248] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:08.294Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e5fdb2263252433dcdab21c0","created_at":"2026-08-12T13:13:40.973Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-a7cd2089aaba4a44","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:40.986Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e5fdb2263252433dcdab21c0: done: 0.199139 sec","job_status":"done","queue_duration_s":87.109248,"scheduling_latency_s":87.109288,"redis_calls":21,"redis_duration_s":0.008277,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003727,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002321,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070686,"duration_s":0.199139,"completed_at":"2026-08-12T13:15:08.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111gitlab # [ 416.494543] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:08.297Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e0674751e7c70b125e20a8ad","created_at":"2026-08-12T13:13:41.226Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-a7cd2089aaba4a44","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:41.240Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e0674751e7c70b125e20a8ad: start","job_status":"start","queue_duration_s":87.056898,"scheduling_latency_s":87.05693}2112gitlab # [ 416.690531] gitaly[892]: time="2026-08-12T13:15:08.583Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:08.581" grpc.time_ms=2.086 pid=892 span.kind=server system=grpc2113gitlab # [ 416.744492] gitaly[892]: time="2026-08-12T13:15:08.638Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:08.637" grpc.time_ms=0.844 pid=892 span.kind=server system=grpc2114gitlab # [ 416.798053] gitaly[892]: time="2026-08-12T13:15:08.692Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:08.691" grpc.time_ms=0.754 pid=892 span.kind=server system=grpc2115gitlab # [ 416.825979] gitaly[892]: time="2026-08-12T13:15:08.706Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N diskcache=67e2788e-2657-4dc4-a95d-fe75c5aa5efe grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:38.124" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:08.524" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 416.846868] gitaly[892]: time="2026-08-12T13:15:08.706Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=201 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7557 command.oublock=0 command.real_time_ms=174 command.spawn_token_fork_ms=1 command.system_time_ms=113 command.user_time_ms=88 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:38.124" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:08.524" grpc.time_ms=181.629 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2118gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.07 seconds)2119gitlab # [ 417.071258] gitaly[892]: time="2026-08-12T13:15:08.963Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-12T13:15:38.560" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:08.961" grpc.time_ms=2.048 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 417.112228] nixbot[3460]: INFO: ::ffff:127.0.0.1:50092 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2121gitlab # [ 417.160080] gitaly[892]: time="2026-08-12T13:15:09.054Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PVARAJ66RQ884SWXZS0N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:39.051" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:09.052" grpc.time_ms=1.489 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 417.203067] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:09.096Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e0674751e7c70b125e20a8ad","created_at":"2026-08-12T13:13:41.226Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-a7cd2089aaba4a44","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-12T13:13:41.240Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e0674751e7c70b125e20a8ad: done: 0.798699 sec","job_status":"done","queue_duration_s":87.056898,"scheduling_latency_s":87.05693,"gitaly_calls":3,"gitaly_duration_s":0.198573,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.045026,"redis_read_bytes":457,"redis_write_bytes":27997,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001949,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002638,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.017019,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.007259,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14491,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.00898,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001048,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000893,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003291,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.104,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.037,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.041,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.054,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.468434,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6900713199999999,"duration_s":0.798699,"completed_at":"2026-08-12T13:15:09.096Z","load_balancing_strategy":"primary","db_duration_s":0.121794,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2123gitlab # [ 417.291047] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:09.100Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8417b3ad99509af4ea626236","created_at":"2026-08-12T13:15:06.098Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:06.119Z","job_size_bytes":46,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8417b3ad99509af4ea626236: start","job_status":"start","queue_duration_s":2.979882,"scheduling_latency_s":2.980689}2124gitlab # [ 417.308036] gitaly[892]: time="2026-08-12T13:15:09.198Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-12T19:15:09.186" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:09.187" grpc.time_ms=10.248 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 417.340642] gitaly[892]: time="2026-08-12T13:15:09.234Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-12T13:15:39.215" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:09.216" grpc.time_ms=18.221 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 417.402293] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:09.295Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"8417b3ad99509af4ea626236","created_at":"2026-08-12T13:15:06.098Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:06.119Z","job_size_bytes":46,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8417b3ad99509af4ea626236: done: 0.19609 sec","job_status":"done","queue_duration_s":2.979882,"scheduling_latency_s":2.980689,"gitaly_calls":2,"gitaly_duration_s":0.036391,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011909,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002335,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001011,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002633,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004682,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.125992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005804,"duration_s":0.19609,"completed_at":"2026-08-12T13:15:09.295Z","load_balancing_strategy":"primary","db_duration_s":0.020339,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2127gitlab # [ 417.490655] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:09.298Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"26d052c08f54d12914817f66","created_at":"2026-08-12T13:15:06.143Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:06.149Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-26d052c08f54d12914817f66: start","job_status":"start","queue_duration_s":3.148991,"scheduling_latency_s":3.149025}2128gitlab # [ 417.511893] gitaly[892]: time="2026-08-12T13:15:09.379Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 diskcache=02675d3b-8d5f-41f5-810e-dc712187daf3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-12T19:15:09.338" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:09.339" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 417.524594] gitaly[892]: time="2026-08-12T13:15:09.379Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=47 command.spawn_token_fork_ms=3 command.system_time_ms=26 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-12T19:15:09.338" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:09.339" grpc.time_ms=39.879 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 417.559097] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:09.452Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"26d052c08f54d12914817f66","created_at":"2026-08-12T13:15:06.143Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:06.149Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-26d052c08f54d12914817f66: done: 0.153728 sec","job_status":"done","queue_duration_s":3.148991,"scheduling_latency_s":3.149025,"gitaly_calls":1,"gitaly_duration_s":0.04411,"redis_calls":15,"redis_duration_s":0.005385,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000624,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000946,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001635,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.019,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.038,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11186764,"duration_s":0.153728,"completed_at":"2026-08-12T13:15:09.452Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2131gitlab # [ 417.614907] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:09.455Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a93f6fea6ca87f90e059f1d6","created_at":"2026-08-12T13:15:06.313Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:06.316Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a93f6fea6ca87f90e059f1d6: start","job_status":"start","queue_duration_s":3.138538,"scheduling_latency_s":3.13857}2132gitlab # [ 417.630747] gitaly[892]: time="2026-08-12T13:15:09.517Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-12T13:15:39.098" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:09.499" grpc.time_ms=18.106 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 417.647477] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:09.540Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a93f6fea6ca87f90e059f1d6","created_at":"2026-08-12T13:15:06.313Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:06.316Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a93f6fea6ca87f90e059f1d6: done: 0.085629 sec","job_status":"done","queue_duration_s":3.138538,"scheduling_latency_s":3.13857,"gitaly_calls":1,"gitaly_duration_s":0.021521,"redis_calls":16,"redis_duration_s":0.006904,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.00073,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001849,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002813,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001512,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.085629,"completed_at":"2026-08-12T13:15:09.540Z","load_balancing_strategy":"primary","db_duration_s":0.005072,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2134gitlab # [ 417.693576] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:09.544Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ab53bbb602302bc922cbaa79","created_at":"2026-08-12T13:15:07.106Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:341e05029580bec77eaf2d2642799695cf9e3e77ab3b7a6ced556c701e4bba8e","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.113Z","job_size_bytes":467,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ab53bbb602302bc922cbaa79: start","job_status":"start","queue_duration_s":2.430984,"scheduling_latency_s":2.431025}2135gitlab # [ 417.711067] gitaly[892]: time="2026-08-12T13:15:09.604Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:39.202" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:09.603" grpc.time_ms=1.196 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2136gitlab # [ 417.731213] gitaly[892]: time="2026-08-12T13:15:09.625Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-12T13:15:19.049" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:09.609" grpc.time_ms=15.819 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 417.937785] gitaly[892]: time="2026-08-12T13:15:09.832Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-12T13:15:39.430" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:09.830" grpc.time_ms=1.448 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 417.975403] gitaly[892]: time="2026-08-12T13:15:09.841Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=28 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-12T13:15:39.436" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:09.837" grpc.time_ms=3.843 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2140gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.07 seconds)2141gitlab # [ 418.133224] gitaly[892]: time="2026-08-12T13:15:10.027Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:20.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:10.009" grpc.time_ms=17.697 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 418.175129] nixbot[3460]: INFO: ::ffff:127.0.0.1:50108 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2143gitlab # [ 418.794491] gitaly[892]: time="2026-08-12T13:15:10.688Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-12T13:15:40.659" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:10.660" grpc.time_ms=27.977 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144gitlab # [ 418.824556] gitaly[892]: time="2026-08-12T13:15:10.718Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PNVCZR7AM6M0CT4TNNF3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-12T13:15:40.693" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:10.694" grpc.time_ms=24.509 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 418.863001] sidekiq-cluster[3421]: {"severity":"WARN","time":"2026-08-12T13:15:10.756Z","class":"CreatePipelineWorker","correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"484f819f5adc66debce15e67fdd30cc44132c6dd","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"484f819f5adc66debce15e67fdd30cc44132c6dd","ref":"refs/heads/master"},"retry":0}2146gitlab # [ 418.881018] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:10.773Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ab53bbb602302bc922cbaa79","created_at":"2026-08-12T13:15:07.106Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:341e05029580bec77eaf2d2642799695cf9e3e77ab3b7a6ced556c701e4bba8e","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.113Z","job_size_bytes":467,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ab53bbb602302bc922cbaa79: done: 1.229569 sec","job_status":"done","queue_duration_s":2.430984,"scheduling_latency_s":2.431025,"gitaly_calls":7,"gitaly_duration_s":0.118054,"redis_calls":51,"redis_duration_s":0.016529,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001623,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006983,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002475,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003848,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.0016,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.021701,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00112618,"duration_s":1.229569,"completed_at":"2026-08-12T13:15:10.773Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.089515,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2147gitlab # [ 418.960534] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:10.779Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"92cbb451-a533-439d-8943-d46d09358ec2\"}"],"class":"WebHookWorker","jid":"d7fc2407a0b4115e617bb8eb","created_at":"2026-08-12T13:15:07.264Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7dc7f9bd231ee3aff4dcac109303aa915db95c0fcaf10cfd71b0c56b301064e2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.272Z","job_size_bytes":1751,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d7fc2407a0b4115e617bb8eb: start","job_status":"start","queue_duration_s":3.506577,"scheduling_latency_s":3.506627}2148gitlab # [ 419.144450] nixbot[3460]: INFO: ::ffff:127.0.0.1:50120 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2149gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2150gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.12 seconds)2151gitlab # [ 419.191177] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:11.083Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"92cbb451-a533-439d-8943-d46d09358ec2\"}"],"class":"WebHookWorker","jid":"d7fc2407a0b4115e617bb8eb","created_at":"2026-08-12T13:15:07.264Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-c9df55a16afb4fb1","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7dc7f9bd231ee3aff4dcac109303aa915db95c0fcaf10cfd71b0c56b301064e2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.272Z","job_size_bytes":1751,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d7fc2407a0b4115e617bb8eb: done: 0.304767 sec","job_status":"done","queue_duration_s":3.506577,"scheduling_latency_s":3.506627,"redis_calls":19,"redis_duration_s":0.008461999999999999,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001969,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000854,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003559,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08973500000001877,"cpu_s":0.186185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0014002,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.304767,"completed_at":"2026-08-12T13:15:11.083Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2152gitlab # [ 419.305120] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:11.089Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7457e405e46b8004b49d19ad","created_at":"2026-08-12T13:15:07.435Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-7d66f86c4c0d4e82","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"26d052c08f54d12914817f66","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.438Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7457e405e46b8004b49d19ad: start","job_status":"start","queue_duration_s":3.650739,"scheduling_latency_s":3.650795}2153gitlab # [ 419.330275] nixbot[3460]: INFO: ::ffff:127.0.0.1:50134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2154gitlab # [ 419.332842] gitaly[892]: time="2026-08-12T13:15:11.158Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H diskcache=b0f1089c-9fb0-431c-8c00-40acb02190d9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-12T19:15:11.135" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:11.136" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 419.344756] gitaly[892]: time="2026-08-12T13:15:11.159Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-12T19:15:11.135" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:11.136" grpc.time_ms=22.313 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 419.358758] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:11.200Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7457e405e46b8004b49d19ad","created_at":"2026-08-12T13:15:07.435Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-7d66f86c4c0d4e82","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"26d052c08f54d12914817f66","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.438Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7457e405e46b8004b49d19ad: done: 0.111859 sec","job_status":"done","queue_duration_s":3.650739,"scheduling_latency_s":3.650795,"gitaly_calls":1,"gitaly_duration_s":0.027567,"redis_calls":12,"redis_duration_s":0.006519,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001489,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.063618,"duration_s":0.111859,"completed_at":"2026-08-12T13:15:11.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab # [ 419.404298] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:11.204Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"650ec277cf5d8d4d851a7362","created_at":"2026-08-12T13:15:07.644Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-7d66f86c4c0d4e82","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a108ddc7f9998f620d4c0cd701d88b0647a5b442f21cca92b5766672d1d4c36b","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.649Z","job_size_bytes":467,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-650ec277cf5d8d4d851a7362: start","job_status":"start","queue_duration_s":3.554955,"scheduling_latency_s":3.554999}2158gitlab # [ 419.422925] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1332159gitlab # [ 419.425089] gitlab-workhorse[816]: time="2026-08-12T13:15:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672160gitlab # [ 419.426893] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 792161gitlab # [ 419.428836] gitaly[892]: time="2026-08-12T13:15:11.228Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SKVQBEYYKX26PA5440A3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:11.217" grpc.time_ms=11.059 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2162gitlab # [ 419.441889] gitaly[892]: time="2026-08-12T13:15:11.264Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:41.261" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:11.262" grpc.time_ms=1.492 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 419.454190] gitaly[892]: time="2026-08-12T13:15:11.283Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-12T13:15:21.268" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:11.268" grpc.time_ms=13.369 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 419.467301] gitaly[892]: time="2026-08-12T13:15:11.308Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SKZZMPQSV336R2XMEN5S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:11.294" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2165gitlab # [ 419.477718] gitaly[892]: time="2026-08-12T13:15:11.309Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SKZZMPQSV336R2XMEN5S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:11.294" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2166gitlab # [ 419.491123] nixbot[3460]: {"ts": "2026-08-12T13:15:11.365Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2167gitlab # [ 419.493585] gitaly[892]: time="2026-08-12T13:15:11.310Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SKZZMPQSV336R2XMEN5S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:11.294" grpc.time_ms=16.368 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2168gitlab # [ 419.507791] gitaly[892]: time="2026-08-12T13:15:11.353Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-12T13:15:41.352" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:11.352" grpc.time_ms=0.964 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 419.520661] gitaly[892]: time="2026-08-12T13:15:11.364Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=158 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-12T13:15:41.358" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:11.359" grpc.time_ms=4.978 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab # [ 419.539685] gitaly[892]: time="2026-08-12T13:15:11.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:21.036" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:11.416" grpc.time_ms=17.184 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 419.585518] gitaly[892]: time="2026-08-12T13:15:11.479Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SM4XPC65X8E40A505XQZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:41.278" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:11.478" grpc.time_ms=0.86 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 419.702698] gitaly[892]: time="2026-08-12T13:15:11.596Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SM4XPC65X8E40A505XQZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:21.049" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:11.579" grpc.time_ms=17.113 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 419.816928] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3212174gitlab # [ 419.825462] nixbot[3460]: {"ts": "2026-08-12T13:15:11.713Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd \"HTTP/1.1 201 Created\""}2175gitlab # [ 419.896842] gitaly[892]: time="2026-08-12T13:15:11.790Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SMF6DNVX94NJQVQDN977 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:41.587" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:11.788" grpc.time_ms=1.275 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 419.993384] gitaly[892]: time="2026-08-12T13:15:11.887Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SMF6DNVX94NJQVQDN977 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:21.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:11.870" grpc.time_ms=16.933 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 420.102260] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2772178gitlab # [ 420.108562] nixbot[3460]: {"ts": "2026-08-12T13:15:11.998Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd \"HTTP/1.1 201 Created\""}2179gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2180gitlab # [ 420.280258] gitaly[892]: time="2026-08-12T13:15:12.174Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-12T13:15:42.147" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:12.148" grpc.time_ms=25.622 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.05 seconds)2182gitlab # [ 420.324320] gitaly[892]: time="2026-08-12T13:15:12.181Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SMRA1E3BG7PW3C05A77C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:42.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:12.173" grpc.time_ms=7.914 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 420.353349] gitaly[892]: time="2026-08-12T13:15:12.200Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1PTGJX87VB4GH66JBQH7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-12T13:15:42.177" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:12.177" grpc.time_ms=22.501 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 420.378936] sidekiq-cluster[3421]: {"severity":"WARN","time":"2026-08-12T13:15:12.232Z","class":"CreatePipelineWorker","correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"484f819f5adc66debce15e67fdd30cc44132c6dd","after":"46730e36718dbbe0d5197aec6d0ce676ee7b68cb","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"46730e36718dbbe0d5197aec6d0ce676ee7b68cb","ref":"refs/heads/master"},"retry":0}2185gitlab # [ 420.389567] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.242Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"650ec277cf5d8d4d851a7362","created_at":"2026-08-12T13:15:07.644Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-7d66f86c4c0d4e82","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a108ddc7f9998f620d4c0cd701d88b0647a5b442f21cca92b5766672d1d4c36b","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.649Z","job_size_bytes":467,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-650ec277cf5d8d4d851a7362: done: 1.037803 sec","job_status":"done","queue_duration_s":3.554955,"scheduling_latency_s":3.554999,"gitaly_calls":7,"gitaly_duration_s":0.111201,"redis_calls":33,"redis_duration_s":0.015067,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000824,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.007926,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002815,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.877898,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.037803,"completed_at":"2026-08-12T13:15:12.242Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046226,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2186gitlab # [ 420.448761] nixbot[3460]: INFO: ::ffff:127.0.0.1:50144 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2187gitlab # [ 420.451032] nixbot[3460]: INFO: ::ffff:127.0.0.1:50146 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2188gitlab # [ 420.452551] gitaly[892]: time="2026-08-12T13:15:12.333Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SMRA1E3BG7PW3C05A77C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:22.132" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:12.313" grpc.time_ms=19.745 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 420.467754] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.245Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"65786cf7-1bb5-4f62-9ae2-7930c5bcb253\"}"],"class":"WebHookWorker","jid":"e45a3eb800a8d85302ab9ebb","created_at":"2026-08-12T13:15:07.680Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-7d66f86c4c0d4e82","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b63871002f940bccd8abd1d72a779bf35b498cef64d14c31cbfbab0c1d81085","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.684Z","job_size_bytes":1749,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e45a3eb800a8d85302ab9ebb: start","job_status":"start","queue_duration_s":4.561137,"scheduling_latency_s":4.561173}2190gitlab # [ 420.486079] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.336Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"65786cf7-1bb5-4f62-9ae2-7930c5bcb253\"}"],"class":"WebHookWorker","jid":"e45a3eb800a8d85302ab9ebb","created_at":"2026-08-12T13:15:07.680Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-7d66f86c4c0d4e82","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b63871002f940bccd8abd1d72a779bf35b498cef64d14c31cbfbab0c1d81085","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:07.684Z","job_size_bytes":1749,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e45a3eb800a8d85302ab9ebb: done: 0.091412 sec","job_status":"done","queue_duration_s":4.561137,"scheduling_latency_s":4.561173,"redis_calls":14,"redis_duration_s":0.008635,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.002984,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003106,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002545,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.010781500000007327,"cpu_s":0.045479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.091412,"completed_at":"2026-08-12T13:15:12.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019742,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2191gitlab # [ 420.534182] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.341Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e314e8f3d90927bb978599db","created_at":"2026-08-12T13:15:08.499Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.508Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e314e8f3d90927bb978599db: start","job_status":"start","queue_duration_s":3.833795,"scheduling_latency_s":3.83383}2192gitlab # [ 420.550769] gitaly[892]: time="2026-08-12T13:15:12.438Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SN2X2C37W2WFM4739T2S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.424" grpc.time_ms=13.516 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2193gitlab # [ 420.564479] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 902194gitlab # [ 420.566647] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 4432195gitlab # [ 420.569183] nixbot[3460]: {"ts": "2026-08-12T13:15:12.451Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/484f819f5adc66debce15e67fdd30cc44132c6dd \"HTTP/1.1 201 Created\""}2196gitlab # [ 420.573689] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e314e8f3d90927bb978599db","created_at":"2026-08-12T13:15:08.499Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.508Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e314e8f3d90927bb978599db: done: 0.125962 sec","job_status":"done","queue_duration_s":3.833795,"scheduling_latency_s":3.83383,"redis_calls":10,"redis_duration_s":0.003754,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059964,"duration_s":0.125962,"completed_at":"2026-08-12T13:15:12.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025352,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2197gitlab # [ 420.618409] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.471Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e912c6a2c36a935b754a73a6","created_at":"2026-08-12T13:15:08.718Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.731Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e912c6a2c36a935b754a73a6: start","job_status":"start","queue_duration_s":3.739941,"scheduling_latency_s":3.739967}2198gitlab # [ 420.635136] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.515Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e912c6a2c36a935b754a73a6","created_at":"2026-08-12T13:15:08.718Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.731Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e912c6a2c36a935b754a73a6: done: 0.043975 sec","job_status":"done","queue_duration_s":3.739941,"scheduling_latency_s":3.739967,"redis_calls":10,"redis_duration_s":0.003513,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000377,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00083562,"duration_s":0.043975,"completed_at":"2026-08-12T13:15:12.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2199gitlab # [ 420.680792] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.517Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"caa8079e0a1a89abd779b743","created_at":"2026-08-12T13:15:08.756Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.770Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-caa8079e0a1a89abd779b743: start","job_status":"start","queue_duration_s":3.746472,"scheduling_latency_s":3.746494}2200gitlab # [ 420.696593] gitlab-workhorse[816]: time="2026-08-12T13:15:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672201gitlab # [ 420.698390] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 862202gitlab # [ 420.700280] gitaly[892]: time="2026-08-12T13:15:12.526Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SN5RN5TCYF0DV5PRRBMH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.514" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2203gitlab # [ 420.710448] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"caa8079e0a1a89abd779b743","created_at":"2026-08-12T13:15:08.756Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.770Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-caa8079e0a1a89abd779b743: done: 0.043199 sec","job_status":"done","queue_duration_s":3.746472,"scheduling_latency_s":3.746494,"redis_calls":10,"redis_duration_s":0.0018340000000000001,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000318,"duration_s":0.043199,"completed_at":"2026-08-12T13:15:12.560Z","load_balancing_strategy":"primary","db_duration_s":0.005983,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2204gitlab # [ 420.754035] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.561Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"fdd40f50cfda153c7d9d6aa0","created_at":"2026-08-12T13:15:08.796Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.806Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-fdd40f50cfda153c7d9d6aa0: start","job_status":"start","queue_duration_s":3.755159,"scheduling_latency_s":3.755177}2205gitlab # [ 420.769637] gitaly[892]: time="2026-08-12T13:15:12.526Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SN5RN5TCYF0DV5PRRBMH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.514" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2206gitlab # [ 420.783413] nix-daemon[3669]: accepted connection from pid 4232, user nixbot2207gitlab # [ 420.785149] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.602Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"fdd40f50cfda153c7d9d6aa0","created_at":"2026-08-12T13:15:08.796Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.806Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-fdd40f50cfda153c7d9d6aa0: done: 0.040485 sec","job_status":"done","queue_duration_s":3.755159,"scheduling_latency_s":3.755177,"redis_calls":13,"redis_duration_s":0.001813,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000315,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000361,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024942,"duration_s":0.040485,"completed_at":"2026-08-12T13:15:12.602Z","load_balancing_strategy":"primary","db_duration_s":0.005351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2208gitlab # [ 420.830468] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.603Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f2e7515cfab2773e6acc8a16","created_at":"2026-08-12T13:15:08.807Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.816Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f2e7515cfab2773e6acc8a16: start","job_status":"start","queue_duration_s":3.786551,"scheduling_latency_s":3.786569}2209gitlab # [ 420.848342] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 852210gitlab # [ 420.850419] gitaly[892]: time="2026-08-12T13:15:12.526Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SN5RN5TCYF0DV5PRRBMH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.514" grpc.time_ms=11.527 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2211gitlab # [ 420.864948] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.641Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f2e7515cfab2773e6acc8a16","created_at":"2026-08-12T13:15:08.807Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.816Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f2e7515cfab2773e6acc8a16: done: 0.03798 sec","job_status":"done","queue_duration_s":3.786551,"scheduling_latency_s":3.786569,"redis_calls":10,"redis_duration_s":0.001567,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023896,"duration_s":0.03798,"completed_at":"2026-08-12T13:15:12.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2212gitlab # [ 420.909552] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.642Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ddc2be1ab066ba79ae856653","created_at":"2026-08-12T13:15:08.818Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.828Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ddc2be1ab066ba79ae856653: start","job_status":"start","queue_duration_s":3.814632,"scheduling_latency_s":3.81465}2213gitlab # [ 420.925773] gitlab-workhorse[816]: time="2026-08-12T13:15:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672214gitlab # [ 420.927520] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 922215gitlab # [ 420.929792] gitaly[892]: time="2026-08-12T13:15:12.654Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SN9SVJ7GSZXSTS5S4SE7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=198 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.645" grpc.time_ms=8.999 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2216gitlab # [ 420.943173] gitaly[892]: time="2026-08-12T13:15:12.747Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNCGXFAW041WZT32SB54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.732" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2217gitlab # [ 420.953522] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.674Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"ddc2be1ab066ba79ae856653","created_at":"2026-08-12T13:15:08.818Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.828Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-ddc2be1ab066ba79ae856653: done: 0.031651 sec","job_status":"done","queue_duration_s":3.814632,"scheduling_latency_s":3.81465,"redis_calls":11,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000316,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002362,"duration_s":0.031651,"completed_at":"2026-08-12T13:15:12.674Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 420.997342] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.675Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"17e75d939787426324958026","created_at":"2026-08-12T13:15:08.832Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.842Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-17e75d939787426324958026: start","job_status":"start","queue_duration_s":3.833562,"scheduling_latency_s":3.833579}2219gitlab # [ 421.014618] gitaly[892]: time="2026-08-12T13:15:12.748Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNCGXFAW041WZT32SB54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.732" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2220gitlab # [ 421.028080] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 702221gitlab # [ 421.030105] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.714Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"17e75d939787426324958026","created_at":"2026-08-12T13:15:08.832Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.842Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-17e75d939787426324958026: done: 0.038349 sec","job_status":"done","queue_duration_s":3.833562,"scheduling_latency_s":3.833579,"redis_calls":10,"redis_duration_s":0.003754,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002578,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028934,"duration_s":0.038349,"completed_at":"2026-08-12T13:15:12.713Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2222gitlab # [ 421.077457] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.717Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c26e6e37a62d6e76a8bd6c5b","created_at":"2026-08-12T13:15:08.844Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.856Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c26e6e37a62d6e76a8bd6c5b: start","job_status":"start","queue_duration_s":3.860909,"scheduling_latency_s":3.860928}2223gitlab # [ 421.095037] gitaly[892]: time="2026-08-12T13:15:12.748Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNCGXFAW041WZT32SB54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.732" grpc.time_ms=16.013 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2224gitlab # [ 421.109991] gitlab-workhorse[816]: time="2026-08-12T13:15:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162225gitlab # [ 421.111817] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1062226gitlab # [ 421.113879] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.761Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c26e6e37a62d6e76a8bd6c5b","created_at":"2026-08-12T13:15:08.844Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.856Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c26e6e37a62d6e76a8bd6c5b: done: 0.044335 sec","job_status":"done","queue_duration_s":3.860909,"scheduling_latency_s":3.860928,"redis_calls":10,"redis_duration_s":0.00407,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000792,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024092,"duration_s":0.044335,"completed_at":"2026-08-12T13:15:12.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004438,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2227gitlab # [ 421.158570] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.762Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2ca65e488be515dc43205a94","created_at":"2026-08-12T13:15:08.872Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.884Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2ca65e488be515dc43205a94: start","job_status":"start","queue_duration_s":3.878449,"scheduling_latency_s":3.878466}2228gitlab # [ 421.175018] gitaly[892]: time="2026-08-12T13:15:12.866Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SNGWXR7P101F9PZF47Q6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.856" grpc.time_ms=9.446 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2229gitlab # [ 421.188665] gitaly[892]: time="2026-08-12T13:15:12.975Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNK5ERQ46G7TE0PE9CNG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.960" pid=892 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2230gitlab # [ 421.198902] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2ca65e488be515dc43205a94","created_at":"2026-08-12T13:15:08.872Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.884Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2ca65e488be515dc43205a94: done: 0.036477 sec","job_status":"done","queue_duration_s":3.878449,"scheduling_latency_s":3.878466,"redis_calls":10,"redis_duration_s":0.001444,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000338,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002401,"duration_s":0.036477,"completed_at":"2026-08-12T13:15:12.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2231gitlab # [ 421.243740] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.800Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0d7789974155f0b5b29048dc","created_at":"2026-08-12T13:15:08.885Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.896Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0d7789974155f0b5b29048dc: start","job_status":"start","queue_duration_s":3.904156,"scheduling_latency_s":3.904173}2232gitlab # [ 421.261144] gitaly[892]: time="2026-08-12T13:15:12.975Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNK5ERQ46G7TE0PE9CNG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.960" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2233gitlab # [ 421.275155] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0d7789974155f0b5b29048dc","created_at":"2026-08-12T13:15:08.885Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.896Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0d7789974155f0b5b29048dc: done: 0.024295 sec","job_status":"done","queue_duration_s":3.904156,"scheduling_latency_s":3.904173,"redis_calls":10,"redis_duration_s":0.0017389999999999999,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025328,"duration_s":0.024295,"completed_at":"2026-08-12T13:15:12.824Z","load_balancing_strategy":"primary","db_duration_s":0.00187,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 421.320218] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f6de3a882f7e15fb56c6dac6","created_at":"2026-08-12T13:15:08.897Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.909Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f6de3a882f7e15fb56c6dac6: start","job_status":"start","queue_duration_s":3.916738,"scheduling_latency_s":3.916756}2235gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb'2236gitlab # [ 421.335843] gitaly[892]: time="2026-08-12T13:15:12.975Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNK5ERQ46G7TE0PE9CNG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:12.960" grpc.time_ms=15.758 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2237gitlab # [ 421.350364] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.865Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f6de3a882f7e15fb56c6dac6","created_at":"2026-08-12T13:15:08.897Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.909Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f6de3a882f7e15fb56c6dac6: done: 0.039089 sec","job_status":"done","queue_duration_s":3.916738,"scheduling_latency_s":3.916756,"redis_calls":10,"redis_duration_s":0.00148,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025298,"duration_s":0.039089,"completed_at":"2026-08-12T13:15:12.865Z","load_balancing_strategy":"primary","db_duration_s":0.006352,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2238gitlab # [ 421.392547] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.866Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"be9ca6f3ef518cac2ee94db7","created_at":"2026-08-12T13:15:08.922Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.934Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-be9ca6f3ef518cac2ee94db7: start","job_status":"start","queue_duration_s":3.931608,"scheduling_latency_s":3.931625}2239gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb', in 0.07 seconds)2240(finished: subtest: push delivers the webhook, in 94.03 seconds)2241subtest: eval and build post commit statuses2242gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/46730e36718dbbe0d5197aec6d0ce676ee7b68cb/statuses2243gitlab # [ 421.409325] gitaly[892]: time="2026-08-12T13:15:13.091Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:43.089" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:13.089" grpc.time_ms=1.726 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2244gitlab # [ 421.421735] nixbot[3460]: INFO: ::ffff:127.0.0.1:34588 - "GET /api/repos/gitlab/root/test-flake/builds?commit=46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 200 OK2245gitlab # [ 421.423664] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.937Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"be9ca6f3ef518cac2ee94db7","created_at":"2026-08-12T13:15:08.922Z","trace_propagation_headers":{"sentry-trace":"d175b8cfc67b429aadc85a26e248b112-3b0d2caf3e3d47ca","baggage":"sentry-trace_id=d175b8cfc67b429aadc85a26e248b112,sentry-release=Unknown"},"correlation_id":"01KZV1PVARAJ66RQ884SWXZS0N","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:08.934Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-be9ca6f3ef518cac2ee94db7: done: 0.070731 sec","job_status":"done","queue_duration_s":3.931608,"scheduling_latency_s":3.931625,"redis_calls":14,"redis_duration_s":0.002893,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001222,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001404,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039576,"duration_s":0.070731,"completed_at":"2026-08-12T13:15:12.937Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2246gitlab # [ 421.469897] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:12.938Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"377c52afaad687adbe2ce95d","created_at":"2026-08-12T13:15:09.256Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-abab4cca5a904524","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:09.268Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-377c52afaad687adbe2ce95d: start","job_status":"start","queue_duration_s":3.670234,"scheduling_latency_s":3.670252}2247gitlab # [ 421.486013] gitaly[892]: time="2026-08-12T13:15:13.118Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-12T13:15:43.006" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:13.106" grpc.time_ms=11.423 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2248gitlab # [ 421.500369] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.010Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"377c52afaad687adbe2ce95d","created_at":"2026-08-12T13:15:09.256Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-abab4cca5a904524","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:09.268Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-377c52afaad687adbe2ce95d: done: 0.071927 sec","job_status":"done","queue_duration_s":3.670234,"scheduling_latency_s":3.670252,"redis_calls":19,"redis_duration_s":0.0067800000000000004,"redis_read_bytes":21,"redis_write_bytes":4288,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002132,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000835,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2259,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002584,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01601586,"duration_s":0.071927,"completed_at":"2026-08-12T13:15:13.010Z","load_balancing_strategy":"primary","db_duration_s":0.010363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2249gitlab # [ 421.545769] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.012Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d7fc2407a0b4115e617bb8eb"],"class":"WebHooks::LogExecutionWorker","jid":"50c7ac4bab3bc2231b088fd8","created_at":"2026-08-12T13:15:11.044Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-0328ec4b572342a5","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a84dd8ed768c6741125aed0cbb5cfc083f3f929194f319d228bbf7e4b33d1b69","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:11.059Z","job_size_bytes":2592,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-50c7ac4bab3bc2231b088fd8: start","job_status":"start","queue_duration_s":1.953055,"scheduling_latency_s":1.953078}2250gitlab # [ 421.562615] gitaly[892]: time="2026-08-12T13:15:13.140Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:23.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:13.127" grpc.time_ms=12.191 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2251gitlab # [ 421.576493] nixbot[3460]: {"ts": "2026-08-12T13:15:13.418Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/46730e36718dbbe0d5197aec6d0ce676ee7b68cb \"HTTP/1.1 201 Created\""}2252gitlab # [ 421.579190] nixbot[3460]: {"ts": "2026-08-12T13:15:13.426Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-46730e36718d-4"}2253gitlab # [ 421.581664] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.081Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d7fc2407a0b4115e617bb8eb"],"class":"WebHooks::LogExecutionWorker","jid":"50c7ac4bab3bc2231b088fd8","created_at":"2026-08-12T13:15:11.044Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-0328ec4b572342a5","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a84dd8ed768c6741125aed0cbb5cfc083f3f929194f319d228bbf7e4b33d1b69","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:11.059Z","job_size_bytes":2592,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-50c7ac4bab3bc2231b088fd8: done: 0.068587 sec","job_status":"done","queue_duration_s":1.953055,"scheduling_latency_s":1.953078,"redis_calls":10,"redis_duration_s":0.002888,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001458,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047774,"duration_s":0.068587,"completed_at":"2026-08-12T13:15:13.081Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017686,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2254gitlab # [ 421.626564] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.083Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"27becf0a33f8403942dd2deb","created_at":"2026-08-12T13:15:11.669Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-f2dab90aa5a849d2","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:11.680Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-27becf0a33f8403942dd2deb: start","job_status":"start","queue_duration_s":1.402837,"scheduling_latency_s":1.402858}2255gitlab # [ 421.643018] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4032256gitlab # [ 421.645724] gitaly[892]: time="2026-08-12T13:15:13.185Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-12T13:15:23.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:13.184" grpc.time_ms=0.303 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2257gitlab # [ 421.657854] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.448Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"27becf0a33f8403942dd2deb","created_at":"2026-08-12T13:15:11.669Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-f2dab90aa5a849d2","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:11.680Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3421,"job_status":"rescheduled","message":"PipelineProcessWorker JID-27becf0a33f8403942dd2deb: rescheduled"}2258gitlab # [ 421.672949] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.457Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"27becf0a33f8403942dd2deb","created_at":"2026-08-12T13:15:11.669Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-f2dab90aa5a849d2","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:11.680Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-27becf0a33f8403942dd2deb: done: 0.374496 sec","job_status":"done","queue_duration_s":1.402837,"scheduling_latency_s":1.402858,"gitaly_calls":3,"gitaly_duration_s":0.139047,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.044995,"redis_read_bytes":150,"redis_write_bytes":18013,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000681,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000997,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.019316,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.012615,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000407,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00285,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.007448,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.152221,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.3206936,"duration_s":0.374496,"completed_at":"2026-08-12T13:15:13.457Z","load_balancing_strategy":"primary","db_duration_s":0.045422,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2259gitlab # [ 421.724816] nix-daemon[3669]: accepted connection from pid 4325, user nixbot2260gitlab # [ 421.725735] nix-daemon[3669]: accepted connection from pid 4334, user nixbot2261gitlab # [ 421.726656] gitaly[892]: time="2026-08-12T13:15:13.198Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-12T13:15:23.010" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:13.190" grpc.time_ms=8.241 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 421.739888] gitaly[892]: time="2026-08-12T13:15:13.223Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SM4XPC65X8E40A505XQZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:13.223" grpc.time_ms=0.609 pid=892 span.kind=server system=grpc2263gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/46730e36718dbbe0d5197aec6d0ce676ee7b68cb/statuses, in 0.35 seconds)2264gitlab # [ 421.749729] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.459Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e45a3eb800a8d85302ab9ebb"],"class":"WebHooks::LogExecutionWorker","jid":"32f9113783d0754527d0e00c","created_at":"2026-08-12T13:15:12.312Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-6c23913f1e304e51","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bd8e83e4120f6b6447bb8aa5403a312217af75626e15cee8964037acb7bd798d","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:12.317Z","job_size_bytes":2592,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-32f9113783d0754527d0e00c: start","job_status":"start","queue_duration_s":1.141965,"scheduling_latency_s":1.141986}2265gitlab # [ 421.765561] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.488Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e45a3eb800a8d85302ab9ebb"],"class":"WebHooks::LogExecutionWorker","jid":"32f9113783d0754527d0e00c","created_at":"2026-08-12T13:15:12.312Z","trace_propagation_headers":{"sentry-trace":"5d3c38c662ec4c1899285bad30bfb829-6c23913f1e304e51","baggage":"sentry-trace_id=5d3c38c662ec4c1899285bad30bfb829,sentry-release=Unknown"},"correlation_id":"01KZV1PTGJX87VB4GH66JBQH7H","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bd8e83e4120f6b6447bb8aa5403a312217af75626e15cee8964037acb7bd798d","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:12.317Z","job_size_bytes":2592,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-32f9113783d0754527d0e00c: done: 0.028823 sec","job_status":"done","queue_duration_s":1.141965,"scheduling_latency_s":1.141986,"redis_calls":7,"redis_duration_s":0.001346,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028823,"completed_at":"2026-08-12T13:15:13.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2266gitlab # [ 421.808590] nixbot[3460]: {"ts": "2026-08-12T13:15:13.612Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-46730e36718d-4", "argv0": "bwrap"}2267gitlab # [ 421.810856] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/46730e36718dbbe0d5197aec6d0ce676ee7b68cb/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 3082268gitlab # [ 421.813509] gitaly[892]: time="2026-08-12T13:15:13.235Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:13.235" grpc.time_ms=0.348 pid=892 span.kind=server system=grpc2269gitlab # [ 421.823088] gitaly[892]: time="2026-08-12T13:15:13.250Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SM4XPC65X8E40A505XQZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:13.249" grpc.time_ms=0.357 pid=892 span.kind=server system=grpc2270gitlab # [ 421.832886] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"2fcbcfb751635944c8c67225","created_at":"2026-08-12T13:15:12.985Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-a7640236d074479e","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:12.996Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-2fcbcfb751635944c8c67225: start","job_status":"start","queue_duration_s":0.493201,"scheduling_latency_s":0.493221}2271gitlab # [ 421.849840] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.604Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"2fcbcfb751635944c8c67225","created_at":"2026-08-12T13:15:12.985Z","trace_propagation_headers":{"sentry-trace":"30731593ea334657a22dc549083b071a-a7640236d074479e","baggage":"sentry-trace_id=30731593ea334657a22dc549083b071a,sentry-release=Unknown"},"correlation_id":"01KZV1PNVCZR7AM6M0CT4TNNF3","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:12.996Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-2fcbcfb751635944c8c67225: done: 0.114868 sec","job_status":"done","queue_duration_s":0.493201,"scheduling_latency_s":0.493221,"redis_calls":11,"redis_duration_s":0.005856,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003678,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046832,"duration_s":0.114868,"completed_at":"2026-08-12T13:15:13.604Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2272gitlab # [ 421.896094] gitaly[892]: time="2026-08-12T13:15:13.260Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:13.260" grpc.time_ms=0.331 pid=892 span.kind=server system=grpc2273gitlab # [ 421.905363] gitaly[892]: time="2026-08-12T13:15:13.266Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 diskcache=8964a0ab-fe94-440d-a59b-2f3027a61806 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-12T13:15:23.020" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:13.201" pid=892 ref=refs/keep-around/46730e36718dbbe0d5197aec6d0ce676ee7b68cb remote_ip="2001:db8:1::1" revision=46730e36718dbbe0d5197aec6d0ce676ee7b68cb span.kind=server system=grpc username=root2274gitlab # [ 421.917012] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.608Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5af42e46b01f76f7b5f56713","created_at":"2026-08-12T13:15:13.160Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.163Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5af42e46b01f76f7b5f56713: start","job_status":"start","queue_duration_s":0.444584,"scheduling_latency_s":0.444606}2275gitlab # [ 421.933655] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.659Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5af42e46b01f76f7b5f56713","created_at":"2026-08-12T13:15:13.160Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.163Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5af42e46b01f76f7b5f56713: done: 0.051519 sec","job_status":"done","queue_duration_s":0.444584,"scheduling_latency_s":0.444606,"redis_calls":7,"redis_duration_s":0.0054719999999999994,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004423,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051519,"completed_at":"2026-08-12T13:15:13.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009401,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2276gitlab # [ 421.979721] gitaly[892]: time="2026-08-12T13:15:13.267Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=57 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5075 command.oublock=8 command.real_time_ms=61 command.spawn_token_fork_ms=0 command.system_time_ms=25 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-12T13:15:23.020" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-12T13:15:13.201" grpc.time_ms=65.928 pid=892 ref=refs/keep-around/46730e36718dbbe0d5197aec6d0ce676ee7b68cb remote_ip="2001:db8:1::1" revision=46730e36718dbbe0d5197aec6d0ce676ee7b68cb span.kind=server system=grpc username=root2277gitlab # [ 421.994494] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.660Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7a51bc49a74e97e5c2ee5707","created_at":"2026-08-12T13:15:13.285Z","trace_propagation_headers":{"sentry-trace":"59dcf46342844d1585a3c94edb6939fa-9c8c0cff31e94c98","baggage":"sentry-trace_id=59dcf46342844d1585a3c94edb6939fa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SNQN82MGDEHFZT2NMS43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.295Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7a51bc49a74e97e5c2ee5707: start","job_status":"start","queue_duration_s":0.365004,"scheduling_latency_s":0.365022}2278gitlab # [ 422.011370] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.693Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7a51bc49a74e97e5c2ee5707","created_at":"2026-08-12T13:15:13.285Z","trace_propagation_headers":{"sentry-trace":"59dcf46342844d1585a3c94edb6939fa-9c8c0cff31e94c98","baggage":"sentry-trace_id=59dcf46342844d1585a3c94edb6939fa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SNQN82MGDEHFZT2NMS43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.295Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7a51bc49a74e97e5c2ee5707: done: 0.032944 sec","job_status":"done","queue_duration_s":0.365004,"scheduling_latency_s":0.365022,"redis_calls":7,"redis_duration_s":0.001523,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001131,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000392,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032944,"completed_at":"2026-08-12T13:15:13.693Z","load_balancing_strategy":"primary","db_duration_s":0.006173,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2279gitlab # [ 422.054435] gitaly[892]: time="2026-08-12T13:15:13.272Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:43.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:13.271" grpc.time_ms=0.275 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2280gitlab # [ 422.067284] gitaly[892]: time="2026-08-12T13:15:13.289Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SM4XPC65X8E40A505XQZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:13.289" grpc.time_ms=0.327 pid=892 span.kind=server system=grpc2281gitlab # [ 422.078089] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.695Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"859dcf071a1a32192752dbd5","created_at":"2026-08-12T13:15:13.297Z","trace_propagation_headers":{"sentry-trace":"59dcf46342844d1585a3c94edb6939fa-9c8c0cff31e94c98","baggage":"sentry-trace_id=59dcf46342844d1585a3c94edb6939fa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SNQN82MGDEHFZT2NMS43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.302Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-859dcf071a1a32192752dbd5: start","job_status":"start","queue_duration_s":0.393104,"scheduling_latency_s":0.393122}2282gitlab # [ 422.095558] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.807Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"859dcf071a1a32192752dbd5","created_at":"2026-08-12T13:15:13.297Z","trace_propagation_headers":{"sentry-trace":"59dcf46342844d1585a3c94edb6939fa-9c8c0cff31e94c98","baggage":"sentry-trace_id=59dcf46342844d1585a3c94edb6939fa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SNQN82MGDEHFZT2NMS43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.302Z","job_size_bytes":65,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-859dcf071a1a32192752dbd5: done: 0.112458 sec","job_status":"done","queue_duration_s":0.393104,"scheduling_latency_s":0.393122,"redis_calls":10,"redis_duration_s":0.012074,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00142,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.112458,"completed_at":"2026-08-12T13:15:13.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040585,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2283gitlab # [ 422.139982] nix-daemon[3669]: accepted connection from pid 4345, user nixbot2284gitlab # [ 422.141026] gitaly[892]: time="2026-08-12T13:15:13.299Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SM4XPC65X8E40A505XQZ diskcache=4f42f237-7ee7-4bb6-aba4-8e6c1488c33c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:43.170" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:13.171" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2285gitlab # [ 422.150594] gitaly[892]: time="2026-08-12T13:15:13.299Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=108 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7221 command.oublock=0 command.real_time_ms=118 command.spawn_token_fork_ms=1 command.system_time_ms=58 command.user_time_ms=50 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SM4XPC65X8E40A505XQZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:43.170" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:13.171" grpc.time_ms=128.362 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2286gitlab # [ 422.163936] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.810Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4289906c22b64e478c368bac","created_at":"2026-08-12T13:15:13.305Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.308Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4289906c22b64e478c368bac: start","job_status":"start","queue_duration_s":0.501768,"scheduling_latency_s":0.501793}2287gitlab # [ 422.181025] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.847Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"4289906c22b64e478c368bac","created_at":"2026-08-12T13:15:13.305Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.308Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-4289906c22b64e478c368bac: done: 0.03761 sec","job_status":"done","queue_duration_s":0.501768,"scheduling_latency_s":0.501793,"redis_calls":7,"redis_duration_s":0.0018870000000000002,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000545,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03761,"completed_at":"2026-08-12T13:15:13.847Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008159,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 422.224196] nix-daemon[3669]: accepted connection from pid 4355, user nixbot2289gitlab # [ 422.225126] gitaly[892]: time="2026-08-12T13:15:13.391Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SM4XPC65X8E40A505XQZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-12T13:15:43.390" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:13.390" grpc.time_ms=0.939 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 422.237789] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.849Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8d3f0a514faee5aae9e73c11","created_at":"2026-08-12T13:15:13.323Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.326Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8d3f0a514faee5aae9e73c11: start","job_status":"start","queue_duration_s":0.523491,"scheduling_latency_s":0.523512}2291gitlab # [ 422.253725] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8d3f0a514faee5aae9e73c11","created_at":"2026-08-12T13:15:13.323Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.326Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8d3f0a514faee5aae9e73c11: done: 0.041098 sec","job_status":"done","queue_duration_s":0.523491,"scheduling_latency_s":0.523512,"redis_calls":7,"redis_duration_s":0.00409,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002931,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041098,"completed_at":"2026-08-12T13:15:13.890Z","load_balancing_strategy":"primary","db_duration_s":0.008962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 422.296855] gitaly[892]: time="2026-08-12T13:15:13.395Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SP1MP42NKKADDC24943Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:43.194" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:13.394" grpc.time_ms=0.414 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 422.309665] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"806b015aec95e80361605281","created_at":"2026-08-12T13:15:13.340Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.343Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-806b015aec95e80361605281: start","job_status":"start","queue_duration_s":0.550745,"scheduling_latency_s":0.550766}2294gitlab # [ 422.324999] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.938Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"806b015aec95e80361605281","created_at":"2026-08-12T13:15:13.340Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.343Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-806b015aec95e80361605281: done: 0.04417 sec","job_status":"done","queue_duration_s":0.550745,"scheduling_latency_s":0.550766,"redis_calls":10,"redis_duration_s":0.004065,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002214,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000798,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04417,"completed_at":"2026-08-12T13:15:13.938Z","load_balancing_strategy":"primary","db_duration_s":0.009551,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2295gitlab # [ 422.368360] gitaly[892]: time="2026-08-12T13:15:13.433Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SM4XPC65X8E40A505XQZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:43.430" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:13.430" grpc.time_ms=2.393 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2296gitlab # [ 422.380747] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.939Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6b93928a59c4359d556eabf7","created_at":"2026-08-12T13:15:13.345Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.347Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6b93928a59c4359d556eabf7: start","job_status":"start","queue_duration_s":0.591937,"scheduling_latency_s":0.591957}2297gitlab # [ 422.397659] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.973Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6b93928a59c4359d556eabf7","created_at":"2026-08-12T13:15:13.345Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.347Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6b93928a59c4359d556eabf7: done: 0.034056 sec","job_status":"done","queue_duration_s":0.591937,"scheduling_latency_s":0.591957,"redis_calls":7,"redis_duration_s":0.001825,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034056,"completed_at":"2026-08-12T13:15:13.973Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2298gitlab # [ 422.440195] gitaly[892]: time="2026-08-12T13:15:14.213Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-12T13:15:44.209" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:14.210" grpc.time_ms=2.183 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2299gitlab # [ 422.452900] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:13.975Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"44f1bdaa820cf45ee44a208d","created_at":"2026-08-12T13:15:13.349Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.352Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-44f1bdaa820cf45ee44a208d: start","job_status":"start","queue_duration_s":0.622804,"scheduling_latency_s":0.622823}2300gitlab # [ 422.468984] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.005Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"44f1bdaa820cf45ee44a208d","created_at":"2026-08-12T13:15:13.349Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.352Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-44f1bdaa820cf45ee44a208d: done: 0.029825 sec","job_status":"done","queue_duration_s":0.622804,"scheduling_latency_s":0.622823,"redis_calls":8,"redis_duration_s":0.002319,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001771,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029825,"completed_at":"2026-08-12T13:15:14.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2301gitlab # [ 422.511823] gitaly[892]: time="2026-08-12T13:15:14.285Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:44.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:14.284" grpc.time_ms=1.135 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2302gitlab # [ 422.524685] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.007Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c7b0caa49882ce8f054ee9c5","created_at":"2026-08-12T13:15:13.353Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.356Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c7b0caa49882ce8f054ee9c5: start","job_status":"start","queue_duration_s":0.651003,"scheduling_latency_s":0.651021}2303gitlab # [ 422.541742] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.036Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c7b0caa49882ce8f054ee9c5","created_at":"2026-08-12T13:15:13.353Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.356Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c7b0caa49882ce8f054ee9c5: done: 0.028935 sec","job_status":"done","queue_duration_s":0.651003,"scheduling_latency_s":0.651021,"redis_calls":7,"redis_duration_s":0.0026160000000000003,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028935,"completed_at":"2026-08-12T13:15:14.036Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004765,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2304gitlab # [ 422.584802] gitaly[892]: time="2026-08-12T13:15:14.296Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SNQN82MGDEHFZT2NMS43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:44.294" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:14.295" grpc.time_ms=0.868 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 422.597188] nixbot[3460]: {"ts": "2026-08-12T13:15:14.428Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/46730e36718dbbe0d5197aec6d0ce676ee7b68cb \"HTTP/1.1 201 Created\""}2306gitlab # [ 422.599809] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.037Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"ddfeb3199ece640043219687","created_at":"2026-08-12T13:15:13.358Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.363Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ddfeb3199ece640043219687: start","job_status":"start","queue_duration_s":0.673836,"scheduling_latency_s":0.673854}2307gitlab # [ 422.616306] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.066Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"ddfeb3199ece640043219687","created_at":"2026-08-12T13:15:13.358Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.363Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ddfeb3199ece640043219687: done: 0.028695 sec","job_status":"done","queue_duration_s":0.673836,"scheduling_latency_s":0.673854,"redis_calls":7,"redis_duration_s":0.001964,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001467,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028695,"completed_at":"2026-08-12T13:15:14.066Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005995,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2308gitlab # [ 422.658782] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2242309gitlab # [ 422.661395] gitaly[892]: time="2026-08-12T13:15:14.365Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:24.174" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:14.356" grpc.time_ms=9.282 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2310gitlab # [ 422.674866] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.068Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a79cb13afcf054c7881fc063","created_at":"2026-08-12T13:15:13.364Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.367Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a79cb13afcf054c7881fc063: start","job_status":"start","queue_duration_s":0.700958,"scheduling_latency_s":0.700977}2311gitlab # [ 422.691775] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.092Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a79cb13afcf054c7881fc063","created_at":"2026-08-12T13:15:13.364Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.367Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a79cb13afcf054c7881fc063: done: 0.024125 sec","job_status":"done","queue_duration_s":0.700958,"scheduling_latency_s":0.700977,"redis_calls":7,"redis_duration_s":0.006957,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004005,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002952,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024125,"completed_at":"2026-08-12T13:15:14.092Z","load_balancing_strategy":"primary","db_duration_s":0.000535,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 422.734390] gitaly[892]: time="2026-08-12T13:15:14.491Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SQ40K8N88V89PJFTKAG3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:44.290" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:14.490" grpc.time_ms=0.618 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 422.747305] nixbot[3460]: {"ts": "2026-08-12T13:15:14.623Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/46730e36718dbbe0d5197aec6d0ce676ee7b68cb \"HTTP/1.1 201 Created\""}2314gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/46730e36718dbbe0d5197aec6d0ce676ee7b68cb/statuses2315gitlab # [ 422.750131] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.093Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6b2d6631e29c8505aa886238","created_at":"2026-08-12T13:15:13.367Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.371Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6b2d6631e29c8505aa886238: start","job_status":"start","queue_duration_s":0.722017,"scheduling_latency_s":0.722033}2316gitlab # [ 422.765510] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.120Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"6b2d6631e29c8505aa886238","created_at":"2026-08-12T13:15:13.367Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.371Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-6b2d6631e29c8505aa886238: done: 0.026392 sec","job_status":"done","queue_duration_s":0.722017,"scheduling_latency_s":0.722033,"redis_calls":7,"redis_duration_s":0.001817,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026392,"completed_at":"2026-08-12T13:15:14.119Z","load_balancing_strategy":"primary","db_duration_s":0.005195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 422.803661] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1902318gitlab # [ 422.806312] gitaly[892]: time="2026-08-12T13:15:14.547Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SQ40K8N88V89PJFTKAG3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:24.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:14.538" grpc.time_ms=8.951 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2319gitlab # [ 422.820756] gitaly[892]: time="2026-08-12T13:15:14.649Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:14.648" grpc.time_ms=0.46 pid=892 span.kind=server system=grpc2320gitlab # [ 422.831192] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.121Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f985abbcdb4e16e7e545dbe3","created_at":"2026-08-12T13:15:13.390Z","trace_propagation_headers":{"sentry-trace":"59dcf46342844d1585a3c94edb6939fa-9c8c0cff31e94c98","baggage":"sentry-trace_id=59dcf46342844d1585a3c94edb6939fa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SNQN82MGDEHFZT2NMS43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.396Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f985abbcdb4e16e7e545dbe3: start","job_status":"start","queue_duration_s":0.725261,"scheduling_latency_s":0.725279}2321gitlab # [ 422.847605] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.311Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f985abbcdb4e16e7e545dbe3","created_at":"2026-08-12T13:15:13.390Z","trace_propagation_headers":{"sentry-trace":"59dcf46342844d1585a3c94edb6939fa-9c8c0cff31e94c98","baggage":"sentry-trace_id=59dcf46342844d1585a3c94edb6939fa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SNQN82MGDEHFZT2NMS43","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.396Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f985abbcdb4e16e7e545dbe3: done: 0.190262 sec","job_status":"done","queue_duration_s":0.725261,"scheduling_latency_s":0.725279,"gitaly_calls":2,"gitaly_duration_s":0.01003,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009447,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00125,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001496,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00034,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001927,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000334,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001371,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001479,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.136285,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15418382,"duration_s":0.190262,"completed_at":"2026-08-12T13:15:14.311Z","load_balancing_strategy":"primary","db_duration_s":0.044881,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2322gitlab # [ 422.901452] gitaly[892]: time="2026-08-12T13:15:14.684Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:14.683" grpc.time_ms=1.127 pid=892 span.kind=server system=grpc2323gitlab # [ 422.911104] gitaly[892]: time="2026-08-12T13:15:14.716Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SQAJ42EQ7YX3RA4060FR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:44.514" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:14.715" grpc.time_ms=0.6 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2324gitlab # [ 422.923990] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.313Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d40fe0d357bc2e3941fea841","created_at":"2026-08-12T13:15:13.448Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.451Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d40fe0d357bc2e3941fea841: start","job_status":"start","queue_duration_s":0.861876,"scheduling_latency_s":0.861893}2325gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/46730e36718dbbe0d5197aec6d0ce676ee7b68cb/statuses, in 0.20 seconds)2326gitlab # [ 422.939542] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.366Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d40fe0d357bc2e3941fea841","created_at":"2026-08-12T13:15:13.448Z","trace_propagation_headers":{"sentry-trace":"34caa801ece64917b9cad88da8721710-d0fe966804034580","baggage":"sentry-trace_id=34caa801ece64917b9cad88da8721710,sentry-release=Unknown"},"correlation_id":"01KZV1SM4XPC65X8E40A505XQZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:13.451Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d40fe0d357bc2e3941fea841: done: 0.053605 sec","job_status":"done","queue_duration_s":0.861876,"scheduling_latency_s":0.861893,"redis_calls":8,"redis_duration_s":0.004533000000000001,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003989,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000544,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053605,"completed_at":"2026-08-12T13:15:14.366Z","load_balancing_strategy":"primary","db_duration_s":0.01149,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2327gitlab # [ 422.981888] gitaly[892]: time="2026-08-12T13:15:14.731Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:14.730" grpc.time_ms=0.723 pid=892 span.kind=server system=grpc2328gitlab # [ 422.991585] gitaly[892]: time="2026-08-12T13:15:14.755Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:44.607" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:14.608" operations="[repack_refs]" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 423.001655] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.369Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"fad6b70ec6fc5a73f2356eed","created_at":"2026-08-12T13:15:14.187Z","trace_propagation_headers":{"sentry-trace":"59dcf46342844d1585a3c94edb6939fa-80f9d1dc888340b3","baggage":"sentry-trace_id=59dcf46342844d1585a3c94edb6939fa,sentry-release=Unknown"},"correlation_id":"01KZV1SNQN82MGDEHFZT2NMS43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.190Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-fad6b70ec6fc5a73f2356eed: start","job_status":"start","queue_duration_s":0.179265,"scheduling_latency_s":0.179299}2330gitlab # [ 423.017771] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"fad6b70ec6fc5a73f2356eed","created_at":"2026-08-12T13:15:14.187Z","trace_propagation_headers":{"sentry-trace":"59dcf46342844d1585a3c94edb6939fa-80f9d1dc888340b3","baggage":"sentry-trace_id=59dcf46342844d1585a3c94edb6939fa,sentry-release=Unknown"},"correlation_id":"01KZV1SNQN82MGDEHFZT2NMS43","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.190Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-fad6b70ec6fc5a73f2356eed: done: 0.070091 sec","job_status":"done","queue_duration_s":0.179265,"scheduling_latency_s":0.179299,"redis_calls":7,"redis_duration_s":0.002408,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.070091,"completed_at":"2026-08-12T13:15:14.439Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 423.060257] nixbot[3460]: {"ts": "2026-08-12T13:15:14.852Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/46730e36718dbbe0d5197aec6d0ce676ee7b68cb \"HTTP/1.1 201 Created\""}2332gitlab # [ 423.062979] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:14 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/46730e36718dbbe0d5197aec6d0ce676ee7b68cb/statuses HTTP/1.1" 200 1295 "" "curl/8.21.0" 1172333gitlab # [ 423.065620] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/46730e36718dbbe0d5197aec6d0ce676ee7b68cb HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2082334gitlab # [ 423.068043] gitaly[892]: time="2026-08-12T13:15:14.759Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:44.607" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:14.608" pid=892 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-12 13:13:32.50037794 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2335gitlab # [ 423.079966] gitaly[892]: time="2026-08-12T13:15:14.759Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH diskcache=4beeb977-68d1-45c2-a65d-e3e7daeda560 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:44.607" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:14.608" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 423.090958] nix-daemon[3669]: accepted connection from pid 4409, user nixbot2337gitlab # [ 423.091895] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.442Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"430204c9f39fc77b60d52206","created_at":"2026-08-12T13:15:14.403Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-52005c84a7194001","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.407Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-430204c9f39fc77b60d52206: start","job_status":"start","queue_duration_s":0.034813,"scheduling_latency_s":0.034842}2338gitlab # [ 423.107875] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.905Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"44baeb5f12aa67608a5c35ae","created_at":"2026-08-12T13:15:14.903Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"430204c9f39fc77b60d52206","job_size_bytes":3,"pid":3421,"job_status":"deduplicated","message":"PipelineProcessWorker JID-44baeb5f12aa67608a5c35ae: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2339gitlab # [ 423.123008] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.907Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"430204c9f39fc77b60d52206","created_at":"2026-08-12T13:15:14.403Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-52005c84a7194001","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.407Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3421,"job_status":"rescheduled","message":"PipelineProcessWorker JID-430204c9f39fc77b60d52206: rescheduled"}2340gitlab # [ 423.137913] gitaly[892]: time="2026-08-12T13:15:14.759Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=121 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6933 command.oublock=0 command.real_time_ms=145 command.spawn_token_fork_ms=1 command.system_time_ms=76 command.user_time_ms=45 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:44.607" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:14.608" grpc.time_ms=151.122 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2341gitlab # [ 423.150958] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.914Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"430204c9f39fc77b60d52206","created_at":"2026-08-12T13:15:14.403Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-52005c84a7194001","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.407Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-430204c9f39fc77b60d52206: done: 0.472774 sec","job_status":"done","queue_duration_s":0.034813,"scheduling_latency_s":0.034842,"gitaly_calls":3,"gitaly_duration_s":0.164181,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.029316000000000002,"redis_read_bytes":239,"redis_write_bytes":21780,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002392,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001349,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.006911,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.011671,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.002134,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000351,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002116,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.066,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.048,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.206944,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.38405266,"duration_s":0.472774,"completed_at":"2026-08-12T13:15:14.914Z","load_balancing_strategy":"primary","db_duration_s":0.070228,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2342gitlab # [ 423.202416] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.916Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6084952277244a3154270ec5","created_at":"2026-08-12T13:15:14.595Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.599Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6084952277244a3154270ec5: start","job_status":"start","queue_duration_s":0.317129,"scheduling_latency_s":0.317153}2343gitlab # [ 423.219429] gitaly[892]: time="2026-08-12T13:15:14.783Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SQAJ42EQ7YX3RA4060FR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-12T13:15:24.241" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:14.772" grpc.time_ms=11.568 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2344gitlab # [ 423.233264] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:15 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 822345gitlab # [ 423.235345] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.966Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6084952277244a3154270ec5","created_at":"2026-08-12T13:15:14.595Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.599Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6084952277244a3154270ec5: done: 0.050097 sec","job_status":"done","queue_duration_s":0.317129,"scheduling_latency_s":0.317153,"redis_calls":7,"redis_duration_s":0.002182,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001613,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050097,"completed_at":"2026-08-12T13:15:14.966Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012562,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2346gitlab # [ 423.279039] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:14.968Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cbc4db44484100281af82459","created_at":"2026-08-12T13:15:14.768Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.771Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cbc4db44484100281af82459: start","job_status":"start","queue_duration_s":0.197369,"scheduling_latency_s":0.197395}2347gitlab # [ 423.297359] gitaly[892]: time="2026-08-12T13:15:14.789Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:44.607" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:14.608" pid=892 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2348gitlab # [ 423.311082] gitaly[892]: time="2026-08-12T13:15:14.789Z" level=info msg="optimized repository" clean_stale_data_time=29.89632ms clean_work_trees_time="172.48µs" commit_graph_time=760ns correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="2.38µs" pid=892 prune_time=240ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.66µs" storage_name=default system=housekeeping total_time=30.1052ms2349gitlab # [ 423.317232] gitlab-workhorse[816]: time="2026-08-12T13:15:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672350gitlab # [ 423.319009] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:15 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 752351gitlab # [ 423.320964] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.002Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cbc4db44484100281af82459","created_at":"2026-08-12T13:15:14.768Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.771Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cbc4db44484100281af82459: done: 0.033621 sec","job_status":"done","queue_duration_s":0.197369,"scheduling_latency_s":0.197395,"redis_calls":7,"redis_duration_s":0.001854,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033621,"completed_at":"2026-08-12T13:15:15.002Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2352gitlab # [ 423.364888] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.006Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d53b29d7c52a753dca144e6c","created_at":"2026-08-12T13:15:14.785Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.788Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d53b29d7c52a753dca144e6c: start","job_status":"start","queue_duration_s":0.21856,"scheduling_latency_s":0.218585}2353gitlab # [ 423.380877] gitaly[892]: time="2026-08-12T13:15:14.789Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:44.607" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:14.608" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 423.390271] gitaly[892]: time="2026-08-12T13:15:14.809Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SQD6H42D1A1E1BF4N8YF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:44.608" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:14.809" grpc.time_ms=0.505 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2355gitlab # [ 423.403839] nix-daemon[3669]: accepted connection from pid 4434, user nixbot2356gitlab # [ 423.405171] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.040Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d53b29d7c52a753dca144e6c","created_at":"2026-08-12T13:15:14.785Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.788Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d53b29d7c52a753dca144e6c: done: 0.033546 sec","job_status":"done","queue_duration_s":0.21856,"scheduling_latency_s":0.218585,"redis_calls":7,"redis_duration_s":0.001305,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033546,"completed_at":"2026-08-12T13:15:15.040Z","load_balancing_strategy":"primary","db_duration_s":0.005626,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2357gitlab # [ 423.447575] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.042Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"452d2dd703da00165083d2db","created_at":"2026-08-12T13:15:14.803Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.805Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-452d2dd703da00165083d2db: start","job_status":"start","queue_duration_s":0.236431,"scheduling_latency_s":0.236457}2358gitlab # [ 423.463714] gitaly[892]: time="2026-08-12T13:15:14.855Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-12T13:15:44.853" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:14.854" grpc.time_ms=0.971 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2359gitlab # [ 423.476754] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.082Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"452d2dd703da00165083d2db","created_at":"2026-08-12T13:15:14.803Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.805Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-452d2dd703da00165083d2db: done: 0.040449 sec","job_status":"done","queue_duration_s":0.236431,"scheduling_latency_s":0.236457,"redis_calls":10,"redis_duration_s":0.002588,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000716,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040449,"completed_at":"2026-08-12T13:15:15.082Z","load_balancing_strategy":"primary","db_duration_s":0.008495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 423.522120] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.084Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7c94215dbb86badeb7564c81","created_at":"2026-08-12T13:15:14.806Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.808Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7c94215dbb86badeb7564c81: start","job_status":"start","queue_duration_s":0.276355,"scheduling_latency_s":0.276384}2361gitlab # [ 423.538922] gitaly[892]: time="2026-08-12T13:15:14.890Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:44.889" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:14.889" grpc.time_ms=0.598 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2362gitlab # [ 423.551666] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.116Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7c94215dbb86badeb7564c81","created_at":"2026-08-12T13:15:14.806Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.808Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7c94215dbb86badeb7564c81: done: 0.031292 sec","job_status":"done","queue_duration_s":0.276355,"scheduling_latency_s":0.276384,"redis_calls":7,"redis_duration_s":0.0019030000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001311,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000592,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031292,"completed_at":"2026-08-12T13:15:15.116Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2363gitlab # [ 423.595485] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.118Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"65c2079b43530d2f78aa4f12","created_at":"2026-08-12T13:15:14.809Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.816Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-65c2079b43530d2f78aa4f12: start","job_status":"start","queue_duration_s":0.302216,"scheduling_latency_s":0.302244}2364gitlab # [ 423.612194] gitaly[892]: time="2026-08-12T13:15:15.080Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SQNQNC3QS4HWP4VCVF9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:15.071" grpc.time_ms=8.654 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2365gitlab # [ 423.625484] gitaly[892]: time="2026-08-12T13:15:15.159Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SQRC46MXSG0ZFVEFXW9N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:15.148" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2366gitlab # [ 423.635809] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.147Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"65c2079b43530d2f78aa4f12","created_at":"2026-08-12T13:15:14.809Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.816Z","job_size_bytes":19,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-65c2079b43530d2f78aa4f12: done: 0.029331 sec","job_status":"done","queue_duration_s":0.302216,"scheduling_latency_s":0.302244,"redis_calls":8,"redis_duration_s":0.002413,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001923,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00049,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029331,"completed_at":"2026-08-12T13:15:15.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2367gitlab # [ 423.679127] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.149Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d9ca8a966808e7f8e7a5232f","created_at":"2026-08-12T13:15:14.819Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.822Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d9ca8a966808e7f8e7a5232f: start","job_status":"start","queue_duration_s":0.327425,"scheduling_latency_s":0.327445}2368gitlab # [ 423.696873] gitaly[892]: time="2026-08-12T13:15:15.160Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SQRC46MXSG0ZFVEFXW9N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:15.148" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2369gitlab # [ 423.710923] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.175Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"d9ca8a966808e7f8e7a5232f","created_at":"2026-08-12T13:15:14.819Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.822Z","job_size_bytes":66,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-d9ca8a966808e7f8e7a5232f: done: 0.026264 sec","job_status":"done","queue_duration_s":0.327425,"scheduling_latency_s":0.327445,"redis_calls":7,"redis_duration_s":0.001489,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000407,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026264,"completed_at":"2026-08-12T13:15:15.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004124,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2370gitlab # [ 423.754797] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.177Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c15e46b4d546e18b80f33eea","created_at":"2026-08-12T13:15:14.823Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.825Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c15e46b4d546e18b80f33eea: start","job_status":"start","queue_duration_s":0.351371,"scheduling_latency_s":0.351389}2371gitlab # [ 423.770623] gitaly[892]: time="2026-08-12T13:15:15.160Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SQRC46MXSG0ZFVEFXW9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-12T13:15:15.148" grpc.time_ms=11.726 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2372gitlab # [ 423.785385] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.225Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c15e46b4d546e18b80f33eea","created_at":"2026-08-12T13:15:14.823Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.825Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c15e46b4d546e18b80f33eea: done: 0.048365 sec","job_status":"done","queue_duration_s":0.351371,"scheduling_latency_s":0.351389,"redis_calls":7,"redis_duration_s":0.0025670000000000003,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048365,"completed_at":"2026-08-12T13:15:15.225Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2373gitlab # [ 423.827640] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.229Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"9ff13b297e1a92b0653f6b13","created_at":"2026-08-12T13:15:14.831Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.833Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9ff13b297e1a92b0653f6b13: start","job_status":"start","queue_duration_s":0.396359,"scheduling_latency_s":0.396395}2374gitlab # [ 423.843962] gitaly[892]: time="2026-08-12T13:15:15.506Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:15.505" grpc.time_ms=0.94 pid=892 span.kind=server system=grpc2375gitlab # [ 423.853591] gitaly[892]: time="2026-08-12T13:15:15.561Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:15.558" grpc.time_ms=2.49 pid=892 span.kind=server system=grpc2376gitlab # [ 423.862872] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.280Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"9ff13b297e1a92b0653f6b13","created_at":"2026-08-12T13:15:14.831Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.833Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9ff13b297e1a92b0653f6b13: done: 0.050304 sec","job_status":"done","queue_duration_s":0.396359,"scheduling_latency_s":0.396395,"redis_calls":7,"redis_duration_s":0.001856,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050304,"completed_at":"2026-08-12T13:15:15.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2377gitlab # [ 423.905885] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.282Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"db498c7ca4f19cc70fbd98d9","created_at":"2026-08-12T13:15:14.834Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.836Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-db498c7ca4f19cc70fbd98d9: start","job_status":"start","queue_duration_s":0.446297,"scheduling_latency_s":0.446328}2378gitlab # [ 423.921851] gitaly[892]: time="2026-08-12T13:15:15.612Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-12T13:15:15.611" grpc.time_ms=0.784 pid=892 span.kind=server system=grpc2379gitlab # [ 423.931384] gitaly[892]: time="2026-08-12T13:15:15.624Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH diskcache=0c2c5f9b-3038-46f7-b0bf-1d3596e1c3fa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:45.445" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:15.446" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2380gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/46730e36718dbbe0d5197aec6d0ce676ee7b68cb/statuses2381gitlab # [ 423.941269] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.308Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"db498c7ca4f19cc70fbd98d9","created_at":"2026-08-12T13:15:14.834Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.836Z","job_size_bytes":6,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-db498c7ca4f19cc70fbd98d9: done: 0.025705 sec","job_status":"done","queue_duration_s":0.446297,"scheduling_latency_s":0.446328,"redis_calls":7,"redis_duration_s":0.002804,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001535,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025705,"completed_at":"2026-08-12T13:15:15.308Z","load_balancing_strategy":"primary","db_duration_s":0.00071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 423.981470] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.310Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"2937b85702972df577baf018","created_at":"2026-08-12T13:15:14.836Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.839Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2937b85702972df577baf018: start","job_status":"start","queue_duration_s":0.470755,"scheduling_latency_s":0.470784}2383gitlab # [ 423.995718] gitaly[892]: time="2026-08-12T13:15:15.625Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=199 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7654 command.oublock=0 command.real_time_ms=170 command.spawn_token_fork_ms=1 command.system_time_ms=105 command.user_time_ms=94 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-12T13:15:45.445" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-12T13:15:15.446" grpc.time_ms=178.052 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2384gitlab # [ 424.008029] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.345Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"2937b85702972df577baf018","created_at":"2026-08-12T13:15:14.836Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.839Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2937b85702972df577baf018: done: 0.035711 sec","job_status":"done","queue_duration_s":0.470755,"scheduling_latency_s":0.470784,"redis_calls":7,"redis_duration_s":0.001632,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035711,"completed_at":"2026-08-12T13:15:15.345Z","load_balancing_strategy":"primary","db_duration_s":0.006275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2385gitlab # [ 424.048998] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:15.347Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"47d79fa5e004ba3f435e25be","created_at":"2026-08-12T13:15:14.907Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.909Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-47d79fa5e004ba3f435e25be: start","job_status":"start","queue_duration_s":0.438336,"scheduling_latency_s":0.43836}2386gitlab # [ 424.064400] gitaly[892]: time="2026-08-12T13:15:15.826Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-12T13:15:45.823" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:15.824" grpc.time_ms=1.583 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2387gitlab # [ 424.117364] gitaly[892]: time="2026-08-12T13:15:16.011Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SPWR01GTC5ZY9MDQ09CH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:46.009" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:16.009" grpc.time_ms=1.634 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2388gitlab # [ 424.168098] gitaly[892]: time="2026-08-12T13:15:16.062Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZV1SRKFTSX9DNE436S3E702 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-12T13:15:46.060" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-12T13:15:16.061" grpc.time_ms=1.199 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2389gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/46730e36718dbbe0d5197aec6d0ce676ee7b68cb/statuses, in 0.29 seconds)2390(finished: subtest: eval and build post commit statuses, in 2.84 seconds)2391(finished: run the VM test script, in 494.87 seconds)2392gitlab # [ 424.192674] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:16.073Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"47d79fa5e004ba3f435e25be","created_at":"2026-08-12T13:15:14.907Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-632922dd97834ba2","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:14.909Z","job_size_bytes":3,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-47d79fa5e004ba3f435e25be: done: 0.725472 sec","job_status":"done","queue_duration_s":0.438336,"scheduling_latency_s":0.43836,"gitaly_calls":3,"gitaly_duration_s":0.217573,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.078092,"redis_read_bytes":145,"redis_write_bytes":16878,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000715,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00964,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.016384,"redis_queues_read_bytes":22,"redis_queues_write_bytes":11227,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.044282,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000361,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002174,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003821,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.161,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.119,"db_ci_duration_s":0.042,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.272564,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.64640112,"duration_s":0.725472,"completed_at":"2026-08-12T13:15:16.073Z","load_balancing_strategy":"primary","db_duration_s":0.163092,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2393gitlab # [ 424.254636] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-08-12T13:15:16.089Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6aae5b1b8621fe28e4f637ea","created_at":"2026-08-12T13:15:15.435Z","trace_propagation_headers":{"sentry-trace":"b38b0059faaa4666abcd120ca088534f-349196479b2c4acb","baggage":"sentry-trace_id=b38b0059faaa4666abcd120ca088534f,sentry-release=Unknown"},"correlation_id":"01KZV1SPWR01GTC5ZY9MDQ09CH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-12T13:15:15.438Z","job_size_bytes":23,"pid":3421,"sidekiq_tid":"m8mt","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6aae5b1b8621fe28e4f637ea: start","job_status":"start","queue_duration_s":0.650849,"scheduling_latency_s":0.650902}2394gitlab # [ 424.271727] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/12:13:15:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/46730e36718dbbe0d5197aec6d0ce676ee7b68cb/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 1862395test script finished in 494.92s2396cleanup2397kill QemuMachine (pid 46)2398gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2399(finished: cleanup, in 1.43 seconds)2400additionally exposed symbols:2401 gitlab,2402 vlan1,2403 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2404[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-12T13:13:38.607Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2405[]2406[]2407[]2408[]2409[]2410[]2411[]2412[]2413[]2414[]2415[]2416[]2417[]2418[]2419[]2420[]2421[]2422[]2423[]2424[]2425[]2426[]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[]2493[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '46730e36718dbbe0d5197aec6d0ce676ee7b68cb', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-12T13:15:13.002440Z', 'started_at': None, 'finished_at': None}]2494[{'id': 5, 'sha': '46730e36718dbbe0d5197aec6d0ce676ee7b68cb', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-12T13:15:13.372Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2495[{'id': 5, 'sha': '46730e36718dbbe0d5197aec6d0ce676ee7b68cb', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-12T13:15:13.372Z', 'started_at': None, 'finished_at': '2026-08-12T13:15:14.393Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '46730e36718dbbe0d5197aec6d0ce676ee7b68cb', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-12T13:15:14.576Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2496[{'id': 5, 'sha': '46730e36718dbbe0d5197aec6d0ce676ee7b68cb', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-12T13:15:13.372Z', 'started_at': None, 'finished_at': '2026-08-12T13:15:14.393Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '46730e36718dbbe0d5197aec6d0ce676ee7b68cb', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-12T13:15:14.576Z', 'started_at': None, 'finished_at': '2026-08-12T13:15:14.820Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]