vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #296
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.riNfUlsPef', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: fef6dcc1-693b-4251-9041-ad52ac990ccf16(finished: start all VMs, in 71.20 seconds)17gitlab # Superblock backups stored on blocks:18gitlab: waiting for unit setup-gitlab.service19gitlab # 32768, 98304, 163840, 22937620gitlab: waiting for the VM to finish booting21gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/y2cyfhmv89xmrf576fwc73h1gvw61r6l-nixos-system-gitlab-test/init regInfo=/nix/store/hymvypwp8whcic42lbnya9xy5372w0s7-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/hymvypwp8whcic42lbnya9xy5372w0s7-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f20000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f30000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f40000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f50000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000031] arm-pv: using stolen time PV108gitlab # [ 0.000446] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000606] Console: colour dummy device 80x25110gitlab # [ 0.000614] printk: legacy console [tty0] enabled111gitlab # [ 0.000802] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000809] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000899] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001045] landlock: Up and running.115gitlab # [ 0.001048] Yama: becoming mindful.116gitlab # [ 0.001479] LSM support for eBPF active117gitlab # [ 0.001699] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001817] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003005] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003727] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003731] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003893] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004955] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.005050] EFI services will not be available.125gitlab # [ 0.005260] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005929] Detected PIPT I-cache on CPU1127gitlab # [ 0.006032] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.006165] GICv3: CPU1: using allocated LPI pending table @0x0000000100f60000129gitlab # [ 0.006293] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007454] Detected PIPT I-cache on CPU2131gitlab # [ 0.007568] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007702] GICv3: CPU2: using allocated LPI pending table @0x0000000100f70000133gitlab # [ 0.007837] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.009051] Detected PIPT I-cache on CPU3135gitlab # [ 0.009176] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.009309] GICv3: CPU3: using allocated LPI pending table @0x0000000100f80000137gitlab # [ 0.009445] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.010000] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.010029] SMP: Total of 4 processors activated.140gitlab # [ 0.010031] CPU: All CPU(s) started at EL1141gitlab # [ 0.010040] CPU features: detected: Branch Target Identification142gitlab # [ 0.010043] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.010046] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.010050] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.010053] CPU features: detected: Common not Private translations146gitlab # [ 0.010056] CPU features: detected: CRC32 instructions147gitlab # [ 0.010059] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.010062] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.010065] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.010068] CPU features: detected: E0PD151gitlab # [ 0.010070] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.010073] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.010076] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.010078] CPU features: detected: Fine Grained Traps155gitlab # [ 0.010081] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.010085] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.010088] CPU features: detected: LSE atomic instructions158gitlab # [ 0.010090] CPU features: detected: Privileged Access Never159gitlab # [ 0.010093] CPU features: detected: PMUv3160gitlab # [ 0.010095] CPU features: detected: RAS Extension Support161gitlab # [ 0.010097] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.010099] CPU features: detected: Random Number Generator163gitlab # [ 0.010102] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.010104] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.010107] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.010110] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.011553] alternatives: applying system-wide alternatives168gitlab # [ 0.014559] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.014830] Memory: 5963784K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.016288] devtmpfs: initialized171gitlab # [ 0.020473] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.020543] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.020760] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.020765] 0 pages in range for non-PLT usage175gitlab # [ 0.020766] 508288 pages in range for PLT usage176gitlab # [ 0.020874] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.021712] DMI not present or invalid.178gitlab # [ 0.025044] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.027541] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.027828] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.029659] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.029682] audit: initializing netlink subsys (disabled)183gitlab # [ 0.029998] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.030453] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.030456] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.030461] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.030464] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.030466] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.030547] cpuidle: using governor ladder190gitlab # [ 0.030583] cpuidle: using governor menu191gitlab # [ 0.030782] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.030992] ASID allocator initialised with 65536 entries193gitlab # [ 0.032106] Serial: AMBA PL011 UART driver194gitlab # [ 0.037122] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.037410] printk: console [ttyAMA0] enabled196gitlab # [ 0.049301] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.049324] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.049333] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.049341] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.049349] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.049357] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.049365] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.049373] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.061029] fbcon: Taking over console205gitlab # [ 0.061042] ACPI: Interpreter disabled.206gitlab # [ 0.062103] iommu: Default domain type: Translated207gitlab # [ 0.062121] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.071709] SCSI subsystem initialized209gitlab # [ 0.072129] usbcore: registered new interface driver usbfs210gitlab # [ 0.072162] usbcore: registered new interface driver hub211gitlab # [ 0.072178] usbcore: registered new device driver usb212gitlab # [ 0.072451] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.072454] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.072462] PTP clock support registered215gitlab # [ 0.072519] EDAC MC: Ver: 3.0.0216gitlab # [ 0.073118] scmi_core: SCMI protocol bus registered217gitlab # [ 0.074076] FPGA manager framework218gitlab # [ 0.074947] vgaarb: loaded219gitlab # [ 0.076877] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.078219] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.078302] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.080592] netfs: FS-Cache loaded223gitlab # [ 0.080851] pnp: PnP ACPI: disabled224gitlab # [ 0.092335] NET: Registered PF_INET protocol family225gitlab # [ 0.095100] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.155671] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.155748] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.155812] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.156202] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.157136] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.157298] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.157392] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.157596] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.157859] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.157884] NET: Registered PF_XDP protocol family236gitlab # [ 0.157905] PCI: CLS 0 bytes, default 64237gitlab # [ 0.158301] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.169560] kvm [1]: HYP mode not available239gitlab # [ 0.251577] Initialise system trusted keyrings240gitlab # [ 0.251957] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.252847] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.252993] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.268201] Key type asymmetric registered244gitlab # [ 0.268216] Asymmetric key parser 'x509' registered245gitlab # [ 0.268293] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.268618] io scheduler mq-deadline registered247gitlab # [ 0.268637] io scheduler kyber registered248gitlab # [ 0.282991] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.285055] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.286483] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.286525] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.286582] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.286593] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.286637] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.286687] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.286941] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.286967] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.286989] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.286996] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.287002] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.287197] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.288115] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.288558] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.288582] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.288630] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.288654] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.289735] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.290163] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.290186] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.290234] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.291229] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.291646] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.291668] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.291717] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.292736] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.293146] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.293169] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.293217] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.294262] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.294694] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.294716] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.294763] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.295735] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.296142] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.296164] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.296211] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.297250] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.297638] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.297660] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.297718] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.297740] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.298785] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.299191] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.299249] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.300286] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.300730] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.300779] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.301622] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.302053] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.302567] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.303054] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.303077] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.303125] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.304153] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.304524] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.304546] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.304603] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.305810] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.305823] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.305829] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.305925] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.306020] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.306125] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.306230] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.306315] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.306410] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.306489] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.306576] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.306657] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.306788] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.306884] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.306918] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.306950] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.306983] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.307016] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.307049] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.307083] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.307116] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.307149] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.307183] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.307217] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.307250] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.307282] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.307314] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.307346] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.307377] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.307410] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.307442] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.307476] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.307508] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.307541] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.307579] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.307588] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.307593] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.310070] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.340441] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.345192] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.350165] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.356407] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.361027] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.366663] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.372370] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.377439] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.383688] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.388138] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.393841] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.406087] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.409566] msm_serial: driver initialized359gitlab # [ 0.409870] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.409969] STM32 USART driver initialized361gitlab # [ 0.457278] loop: module loaded362gitlab # [ 0.457894] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.463676] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.468742] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.474070] virtio_blk virtio5: [vdb] 12283392 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.479686] megasas: 07.734.00.00-rc1367gitlab # [ 0.481896] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.487597] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.487771] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.493004] Using buffer write method371gitlab # [ 0.493079] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.497760] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.497799] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.502740] Using buffer write method375gitlab # [ 0.502777] Concatenating MTD devices:376gitlab # [ 0.502784] (0): "0.flash"377gitlab # [ 0.502791] (1): "0.flash"378gitlab # [ 0.502796] into device "0.flash"379gitlab # [ 0.619776] Freeing initrd memory: 27184K380gitlab # [ 0.638506] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.647745] thunder_xcv, ver 1.0382gitlab # [ 0.647871] thunder_bgx, ver 1.0383gitlab # [ 0.647935] nicpf, ver 1.0384gitlab # [ 0.649766] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.649779] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.649847] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.649862] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.649958] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.649968] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.650036] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.650047] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.650459] sky2: driver version 1.30393gitlab # [ 0.655375] usbcore: registered new interface driver usb-storage394gitlab # [ 0.655691] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.655731] usbserial: USB Serial support registered for generic396gitlab # [ 0.655848] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.655924] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.656518] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.657612] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.660188] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.660251] rtc-pl031 9010000.pl031: setting system clock to 2026-09-01T10:31:57 UTC (1788258717)402gitlab # [ 0.661227] i2c_dev: i2c /dev entries driver403gitlab # [ 0.665022] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.665823] hub 1-0:1.0: USB hub found405gitlab # [ 0.665849] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.669869] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.669887] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.670718] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.671859] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.676371] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.677267] usbcore: registered new interface driver usbhid412gitlab # [ 0.677278] usbhid: USB HID core driver413gitlab # [ 0.683131] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.687804] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.688199] NET: Registered PF_INET6 protocol family416gitlab # [ 0.689890] Segment Routing with IPv6417gitlab # [ 0.689923] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.690015] NET: Registered PF_PACKET protocol family419gitlab # [ 0.690390] 9pnet: Installing 9P2000 support420gitlab # [ 0.694399] Key type dns_resolver registered421gitlab # [ 0.711157] registered taskstats version 1422gitlab # [ 0.711597] Loading compiled-in X.509 certificates423gitlab # [ 0.730471] Demotion targets for Node 0: null424gitlab # [ 0.730703] Key type .fscrypt registered425gitlab # [ 0.730710] Key type fscrypt-provisioning registered426gitlab # [ 0.730889] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.730911] ima: Allocated hash algorithm: sha1428gitlab # [ 0.730954] ima: No architecture policies found429gitlab # [ 0.732112] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.758319] clk: Disabling unused clocks431gitlab # [ 0.758355] PM: genpd: Disabling unused power domains432gitlab # [ 0.763093] Freeing unused kernel memory: 4736K433gitlab # [ 0.763321] Run /init as init process434gitlab # [ 0.791765] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.916980] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.073697] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.126241] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.126306] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.126375] systemd[1]: Detected architecture arm64.440gitlab # [ 1.126392] systemd[1]: Running in initrd.441gitlab # [ 1.127224] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.127597] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.189578] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.312970] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.361628] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.438214] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.464464] systemd[1]: Created slice Slice /system/modprobe.448gitlab # [ 1.464760] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.449gitlab # [ 1.464803] systemd[1]: Expecting device /dev/disk/by-label/nix-store...450gitlab # [ 1.464819] systemd[1]: Expecting device /dev/disk/by-label/nixos...451gitlab # [ 1.464847] systemd[1]: Reached target Path Units.452gitlab # [ 1.464867] systemd[1]: Reached target Slice Units.453gitlab # [ 1.464995] systemd[1]: Reached target Swaps.454gitlab # [ 1.465019] systemd[1]: Reached target Timer Units.455gitlab # [ 1.465230] systemd[1]: Listening on D-Bus System Message Bus Socket.456gitlab # [ 1.465431] systemd[1]: Listening on Journal Socket (/dev/log).457gitlab # [ 1.465630] systemd[1]: Listening on Journal Sockets.458gitlab # [ 1.465804] systemd[1]: Listening on udev Control Socket.459gitlab # [ 1.465915] systemd[1]: Listening on udev Kernel Socket.460gitlab # [ 1.465941] systemd[1]: Reached target Socket Units.461gitlab # [ 1.468092] systemd[1]: Starting Create List of Static Device Nodes...462gitlab # [ 1.470305] systemd[1]: Starting Load Kernel Module 9pnet_virtio...463gitlab # [ 1.470391] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs464gitlab # [ 1.472432] systemd[1]: Mounting Kernel Configuration File System...465gitlab # [ 1.483706] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2466gitlab # [ 1.484112] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0467gitlab # [ 1.500736] systemd[1]: Starting Journal Service...468gitlab # [ 1.505092] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.505223] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.506898] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.508842] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.513920] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.515113] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.515469] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.521123] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.550260] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.477gitlab # [ 1.553058] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev478gitlab # [ 1.555721] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0479gitlab # [ 1.555984] [drm] features: -virgl +edid -resource_blob -host_visible480gitlab # [ 1.555987] [drm] features: -context_init481gitlab # [ 1.557044] [drm] number of scanouts: 1482gitlab # [ 1.557068] [drm] number of cap sets: 0483gitlab # [ 1.557702] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic484gitlab # [ 1.557709] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0485gitlab # [ 1.560948] Console: switching to colour frame buffer device 160x50486gitlab # [ 1.564615] systemd-journald[96]: Collecting audit messages is disabled.487gitlab # [ 1.567432] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device488gitlab # [ 1.587496] systemd[1]: Finished Load Kernel Modules.489gitlab # [ 1.590685] systemd[1]: Starting Apply Kernel Variables...490gitlab # [ 1.621762] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.491gitlab # [ 1.625227] systemd[1]: Starting Create Static Device Nodes in /dev...492gitlab # [ 1.643675] systemd[1]: Started Journal Service.493gitlab # [ 1.639416] systemd-modules-load[97]: Using 4 probe threads494gitlab # [ 1.643442] systemd-modules-load[97]: Module 'virtio_balloon' is built in495gitlab # [ 1.644894] systemd-modules-load[97]: Module 'virtio_console' is built in496gitlab # [ 1.646013] systemd-modules-load[97]: Module 'virtio_rng' is built in497gitlab # [ 1.647067] systemd-modules-load[97]: Inserted module 'dm_mod'498gitlab # [ 1.648075] systemd-modules-load[97]: Inserted module 'virtio_gpu'499gitlab # [ 1.649307] systemd[1]: Finished Apply Kernel Variables.500gitlab # [ 1.655996] systemd[1]: Finished Create Static Device Nodes in /dev.501gitlab # [ 1.657351] systemd[1]: Reached target Preparation for Local File Systems.502gitlab # [ 1.658291] systemd[1]: Reached target Local File Systems.503gitlab # [ 1.659799] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.662913] systemd[1]: Starting Rule-based Manager for Device Events and Files...505gitlab # [ 1.710576] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.721618] systemd-udevd[116]: Using default interface naming scheme 'v261'.507gitlab # [ 1.739750] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.780770] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.846922] systemd-vconsole-setup[134]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.851321] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.159723] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.162461] systemd[1]: Reached target System Initialization.513gitlab # [ 2.166186] systemd[1]: Reached target Basic System.514gitlab # [ 2.345260] (udev-worker)[146]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.346946] systemd[1]: Found device /dev/disk/by-label/nixos.516gitlab # [ 2.348379] systemd[1]: Reached target Initrd Root Device.517gitlab # [ 2.349758] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...518gitlab # [ 2.369158] systemd[1]: Found device /dev/disk/by-label/nix-store.519gitlab # [ 2.386642] (udev-worker)[130]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.520gitlab # [ 2.392848] (udev-worker)[130]: Network interface NamePolicy= disabled on kernel command line.521gitlab # [ 2.405431] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.412508] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.505225] systemd[1]: Mounting /sysroot...524gitlab # [ 2.556546] EXT4-fs (vda): mounted filesystem fef6dcc1-693b-4251-9041-ad52ac990ccf r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.555159] systemd[1]: Mounted /sysroot.526gitlab # [ 2.557350] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.561851] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.563235] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.569362] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.576355] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.588447] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.591934] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.609623] systemd[1]: Mounted /sysroot/run.[ 2.615462] erofs (device vdb): mounted with root inode @ nid 128.534gitlab # 535gitlab # [ 2.618578] systemd[1]: Mounted /sysroot/nix/.ro-store.536gitlab # [ 2.620294] systemd-sysroot-fstab-check[170]: /sysroot should be mounted in the initrd, will request daemon-reload.537gitlab # [ 2.625046] systemd[1]: Mounted /sysroot/nix/.rw-store.538gitlab # [ 2.626274] systemd[1]: Mounted /sysroot/tmp/shared.539gitlab # [ 2.627339] systemd[1]: Starting rw-sysroot-nix-store.service...540gitlab # [ 2.628386] systemd[1]: Mounted /sysroot/tmp/xchg.541gitlab # [ 2.629162] systemd[1]: Reload requested from client PID 170 ('systemd-sysroot') (unit initrd-parse-etc.service)...542gitlab # [ 2.630751] systemd[1]: Reloading...543gitlab # [ 2.734372] systemd[1]: Reloading finished in 104 ms.544gitlab # [ 2.784699] systemd-sysroot-fstab-check[170]: Requesting initrd-fs.target/start/replace...545gitlab # [ 2.786184] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.788310] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.790473] systemd-sysroot-fstab-check[170]: Requesting swap.target/start/replace...548gitlab # [ 2.794469] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 2.795479] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 2.796637] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 2.797600] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 2.816999] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.818710] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 2.939612] (udev-worker)[127]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 2.943492] (udev-worker)[127]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 2.947912] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 2.952161] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 2.953262] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 2.954076] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 2.976889] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 2.978172] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 2.979059] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 3.002296] systemd-vconsole-setup[201]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 3.004441] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 3.511396] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 3.584878] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 3.587233] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 3.589813] systemd[1]: Starting Find NixOS closure...569gitlab # [ 3.592290] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 3.634928] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 3.639181] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 3.654998] systemd[1]: Finished Find NixOS closure.573gitlab # [ 3.657623] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 3.660336] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 3.718699] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 3.721488] systemd[1]: Stopped target Basic System.577gitlab # [ 3.723927] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 3.726445] systemd[1]: Stopped target Path Units.579gitlab # [ 3.728688] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 3.731935] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 3.735268] systemd[1]: Stopped target Slice Units.582gitlab # [ 3.737580] systemd[1]: Stopped target Socket Units.583gitlab # [ 3.739836] systemd[1]: Stopped target System Initialization.584gitlab # [ 3.745078] systemd[1]: Stopped target Swaps.585gitlab # [ 3.747065] systemd[1]: Stopped target Timer Units.586gitlab # [ 3.754545] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 3.759899] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 3.764720] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 3.769478] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 3.771719] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 3.775832] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 3.778848] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 3.781759] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 3.783824] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 3.786732] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 3.788879] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 3.791673] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 3.794741] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 3.797730] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 3.800002] systemd[1]: Stopped target Local File Systems.601gitlab # [ 3.803256] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 3.806080] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 3.808915] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 3.811118] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 3.814096] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 3.817090] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 3.818931] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 3.821259] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 3.823245] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.610gitlab # [ 3.825507] systemd[1]: Finished rw-sysroot-nix-store.service.611gitlab # [ 3.827276] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.612gitlab # [ 3.829663] systemd[1]: Finished Load Kernel Module 9pnet_virtio.613gitlab # [ 3.831397] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 3.833386] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 3.835244] systemd[1]: systemd-udevd.service: Consumed 2.286s CPU time over 2.131s wall clock time, 31.3M memory peak.616gitlab # [ 3.837931] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 3.839679] systemd[1]: Closed udev Control Socket.618gitlab # [ 3.841016] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 3.842302] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 3.844064] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 3.845470] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 3.847208] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 3.848804] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 3.850246] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 3.902362] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 3.905737] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 3.908126] systemd[1]: Reached target Switch Root.628gitlab # [ 3.910351] systemd[1]: Starting NixOS Activation...629gitlab # [ 4.086621] initrd-nixos-activation-start[226]: booting system configuration /nix/store/y2cyfhmv89xmrf576fwc73h1gvw61r6l-nixos-system-gitlab-test630gitlab # [ 4.152093] initrd-nixos-activation-start[226]: running activation script...631gitlab # [ 4.494042] initrd-nixos-activation-start[249]: setting up /etc...632gitlab # [ 4.699989] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 4.703995] systemd[1]: Finished NixOS Activation.634gitlab # [ 4.716464] systemd[1]: Starting Switch Root...635gitlab # [ 4.783093] systemd[1]: Switching root.636gitlab # [ 4.911076] systemd-journald[96]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 5.542999] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 5.543150] systemd[1]: Detected virtualization qemu.639gitlab # [ 5.543237] systemd[1]: Detected architecture arm64.640gitlab # [ 5.543445] systemd[1]: Detected first boot.641gitlab # [ 5.545073] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 5.804209] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 5.924333] systemd[1]: Applying preset policy.644gitlab # [ 6.094066] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 6.247973] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 6.248424] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 6.251079] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 6.255863] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 6.262686] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 6.266893] systemd[1]: Created slice User and Session Slice.651gitlab # [ 6.268425] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 6.269899] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 6.271101] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 6.272202] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 6.273364] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 6.274524] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 6.275640] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 6.276737] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 6.277913] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 6.279060] systemd[1]: Reached target Path Units.661gitlab # [ 6.280214] systemd[1]: Reached target Remote File Systems.662gitlab # [ 6.281344] systemd[1]: Reached target Slice Units.663gitlab # [ 6.282463] systemd[1]: Reached target Swaps.664gitlab # [ 6.286644] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 6.291042] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 6.294268] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 6.298013] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 6.299320] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 6.308909] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 6.310831] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 6.314343] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 6.315615] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 6.316572] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 6.317442] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 6.322064] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 6.323065] systemd[1]: Listening on udev Control Socket.677gitlab # [ 6.324086] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 6.331864] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 6.339028] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 6.352337] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 6.369268] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 6.377402] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 6.382895] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 6.383718] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 6.397172] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 6.398081] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 6.398951] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 6.408384] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 6.411117] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 6.419055] systemd[1]: Starting Journal Service...691gitlab # [ 6.422530] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 6.433100] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 6.437474] systemd[1]: Starting Remount Root and Kernel File Systems...694gitlab # [ 6.438152] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os695gitlab # [ 6.440236] fuse: init (API version 7.45)696gitlab # [ 6.455952] systemd[1]: Starting Coldplug All udev Devices...697gitlab # [ 6.467316] systemd[1]: Listening on Journal Log Access Socket.698gitlab # [ 6.468414] systemd[1]: Mounted Huge Pages File System.699gitlab # [ 6.470521] systemd[1]: Mounted POSIX Message Queue File System.700gitlab # [ 6.471538] systemd[1]: Mounted Kernel Debug File System.701gitlab # [ 6.472489] systemd[1]: Mounted Kernel Trace File System.702gitlab # [ 6.474002] systemd[1]: Finished Create List of Static Device Nodes.703gitlab # [ 6.477459] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.704gitlab # [ 6.478642] systemd[1]: Finished Load Kernel Module 9pnet_virtio.705gitlab # [ 6.479780] systemd[1]: Mounted Kernel Configuration File System.706gitlab # [ 6.480996] systemd[1]: modprobe@fuse.service: Deactivated successfully.707gitlab # [ 6.482159] systemd[1]: Finished Load Kernel Module fuse.708gitlab # [ 6.483629] systemd[1]: Finished Load Kernel Modules.709gitlab # [ 6.486875] systemd-journald[320]: Collecting audit messages is enabled.710gitlab # [ 6.489837] EXT4-fs (vda): re-mounted fef6dcc1-693b-4251-9041-ad52ac990ccf.711gitlab # [ 6.497747] systemd[1]: Mounting FUSE Control File System...712gitlab # [ 6.507191] systemd[1]: Starting Firewall...713gitlab # [ 6.518613] systemd[1]: Queued start job for default target Multi-User System.714gitlab # [ 6.526415] systemd[1]: Starting Apply Kernel Variables...715gitlab # [ 6.536030] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...716gitlab # [ 6.542808] systemd[1]: Started Journal Service.717gitlab # [ 6.521172] systemd[1]: Unnecessary job was removed for /dev/vdb.718gitlab # [ 7.147845] systemd-journald[320]: Received client request to flush runtime journal.719gitlab # [ 7.165453] systemd[1]: systemd-journald.service: Deactivated successfully.720gitlab # [ 7.166951] systemd-modules-load[321]: Using 3 probe threads721gitlab # [ 7.167965] systemd-modules-load[321]: Module 'atkbd' is built in722gitlab # [ 7.169169] systemd-modules-load[321]: Module 'loop' is built in723gitlab # [ 7.170235] systemd-modules-load[321]: Inserted module 'tls'724gitlab # [ 7.171721] systemd-oomd[322]: No swap; memory pressure usage will be degraded725gitlab # [ 7.173415] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.726gitlab # [ 7.174537] systemd[1]: Finished Remount Root and Kernel File Systems.727gitlab # [ 7.175630] systemd[1]: Listening on Disk Image Download Service Socket.728gitlab # [ 7.176786] systemd[1]: Starting Flush Journal to Persistent Storage...729gitlab # [ 7.177868] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore730gitlab # [ 7.179581] systemd[1]: Starting Load/Save OS Random Seed...731gitlab # [ 7.180703] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os732gitlab # [ 7.182066] systemd[1]: Mounted FUSE Control File System.733gitlab # [ 7.183010] systemd[1]: Finished Apply Kernel Variables.734gitlab # [ 7.183926] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.735gitlab # [ 7.185180] systemd[1]: Starting Create Static Device Nodes in /dev...736gitlab # [ 7.186229] systemd[1]: Finished Load/Save OS Random Seed.737gitlab # [ 7.187123] systemd[1]: Reached target First Boot Complete.738gitlab # [ 7.187927] systemd[1]: Finished Create Static Device Nodes in /dev.739gitlab # [ 7.188918] systemd[1]: Reached target Preparation for Local File Systems.740gitlab # [ 7.191090] systemd[1]: Starting Rule-based Manager for Device Events and Files...741gitlab # [ 7.192534] systemd-udevd[347]: Using default interface naming scheme 'v261'.742gitlab # [ 7.194027] systemd[1]: Started Rule-based Manager for Device Events and Files.743gitlab # [ 7.195125] systemd[1]: Finished Firewall.744gitlab # [ 7.195774] systemd[1]: Finished Coldplug All udev Devices.745gitlab # [ 7.196657] systemd[1]: Finished Flush Journal to Persistent Storage.746gitlab # [ 7.210139] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 7.270424] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.748gitlab # [ 7.274402] systemd[1]: Mounting /run/wrappers...749gitlab # [ 7.298177] (udev-worker)[382]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.750gitlab # [ 7.300728] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.751gitlab # [ 7.302353] (udev-worker)[475]: Network interface NamePolicy= disabled on kernel command line.752gitlab # [ 7.311966] (udev-worker)[382]: Network interface NamePolicy= disabled on kernel command line.753gitlab # [ 7.321017] systemd[1]: Mounted /run/wrappers.754gitlab # [ 7.324104] systemd[1]: Reached target Local File Systems.755gitlab # [ 7.326949] systemd[1]: Listening on Boot Loader Control Service Socket.756gitlab # [ 7.332287] systemd[1]: Starting register-nix-paths.service...757gitlab # [ 7.337130] systemd[1]: Starting Create SUID/SGID Wrappers...758gitlab # [ 7.338722] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.759gitlab # [ 7.352219] systemd[1]: Starting Save Transient machine-id to Disk...760gitlab # [ 7.356532] systemd[1]: Starting Create System Files and Directories...761gitlab # [ 7.365417] systemd[1]: Condition check resulted in Virtio network device being skipped.762gitlab # [ 7.389389] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.763gitlab # [ 7.392199] systemd[1]: Finished Save Transient machine-id to Disk.764gitlab # [ 7.396188] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore765gitlab # [ 7.398109] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.766gitlab # [ 7.399834] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67767gitlab # [ 7.404130] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore768gitlab # [ 7.406524] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os769gitlab # [ 7.408254] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os770gitlab # [ 7.414361] systemd[1]: Finished Create System Files and Directories.771gitlab # [ 7.417212] systemd[1]: Starting Rebuild Journal Catalog...772gitlab # [ 7.423753] systemd[1]: Starting Record System Boot/Shutdown in UTMP...773gitlab # [ 7.458473] systemd[1]: Finished Record System Boot/Shutdown in UTMP.774gitlab # [ 7.468331] systemd[1]: Finished Rebuild Journal Catalog.775gitlab # [ 7.480686] mousedev: PS/2 mouse device common for all mice776gitlab # [ 7.476266] systemd[1]: Starting Update is Completed...777gitlab # [ 7.515156] systemd[1]: Finished Update is Completed.778gitlab # [ 7.546399] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.779gitlab # [ 7.549044] systemd[1]: Finished Create SUID/SGID Wrappers.780gitlab # [ 7.550132] systemd[1]: suid-sgid-wrappers.service: Consumed 144ms CPU time over 209ms wall clock time, 6.3M memory peak, 1.9M read from disk.781gitlab # [ 7.818376] systemd[1]: Finished register-nix-paths.service.782gitlab # [ 7.819575] systemd[1]: Reached target System Initialization.783gitlab # [ 7.820963] systemd[1]: Started Discard unused filesystem blocks once a week.784gitlab # [ 7.822625] systemd[1]: Started logrotate.timer.785gitlab # [ 7.823729] systemd[1]: Started Daily Cleanup of Temporary Directories.786gitlab # [ 7.825592] systemd[1]: Reached target Timer Units.787gitlab # [ 7.826722] systemd[1]: Listening on D-Bus System Message Bus Socket.788gitlab # [ 7.827900] systemd[1]: Listening on Nix Daemon Socket.789gitlab # [ 7.838160] systemd[1]: Starting nixbot CI service socket...790gitlab # [ 7.839194] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.791gitlab # [ 7.843777] systemd[1]: Starting D-Bus System Message Bus...792gitlab # [ 7.845475] systemd[1]: Listening on nixbot CI service socket.793gitlab # [ 7.846730] systemd[1]: Reached target Socket Units.794gitlab # [ 7.883776] dbus-broker-launch[563]: Looking up NSS user entry for 'systemd-timesync'...795gitlab # [ 7.885730] dbus-broker-launch[563]: NSS returned no entry for 'systemd-timesync'796gitlab # [ 7.889320] dbus-broker-launch[563]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"797gitlab # [ 7.895989] systemd[1]: Started D-Bus System Message Bus.798gitlab # [ 7.902188] dbus-broker-launch[563]: Ready799gitlab # [ 7.903560] systemd[1]: Reached target Basic System.800gitlab # [ 7.906682] systemd[1]: Started backdoor.service.801gitlab # [ 7.912515] systemd[1]: Starting gitlab-config.service...802gitlab # [ 7.932299] systemd[1]: Starting Import lastlog data into lastlog2 database...803gitlab # [ 7.938923] systemd[1]: Starting Logrotate configuration check...804gitlab # [ 7.944551] systemd[1]: Starting Name Service Cache Daemon (nsncd)...805gitlab # [ 7.955117] systemd[1]: Starting Post-Boot Actions...806gitlab # [ 7.958428] systemd[1]: Started Reset console on configuration changes.807gitlab # connecting to host...808gitlab # [ 7.967205] logrotate[570]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.809gitlab # [ 7.973886] logrotate[570]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf810gitlab # [ 7.975182] logrotate[570]: note: 'monthly' overrides previously specified 'weekly'811gitlab # [ 7.977847] logrotate[570]: Reading state from file: /var/lib/logrotate.status812gitlab # [ 7.980172] logrotate[570]: state file /var/lib/logrotate.status does not exist813gitlab # [ 7.984160] logrotate[570]: Allocating hash table for state file, size 64 entries814gitlab # [ 7.985374] logrotate[570]: Handling 4 logs815gitlab # [ 7.985991] logrotate[570]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed816gitlab # [ 7.988688] logrotate[570]: considering log /var/log/btmp817gitlab # [ 7.989438] logrotate[570]: Creating new state818gitlab: Guest shell says: b'Spawning backdoor root shell...\n'819gitlab # [ 7.990036] logrotate[570]: Now: 2026-09-01 10:32820gitlab # [ 7.990749] logrotate[570]: Last rotated at 2026-09-01 10:00821gitlab # [ 7.991530] logrotate[570]: log does not need rotating (log has already been rotated)822gitlab: connected to guest root shell823gitlab # [ 7.993203] logrotate[570]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed824gitlab: (connecting took 8.46 seconds)825gitlab # [ 7.995085] logrotate[570]: considering log /var/log/wtmp826gitlab: (finished: waiting for the VM to finish booting, in 8.46 seconds)827gitlab # [ 7.995758] logrotate[570]: Creating new state828gitlab # [ 7.996432] logrotate[570]: Now: 2026-09-01 10:32829gitlab # [ 7.997120] logrotate[570]: Last rotated at 2026-09-01 10:00830gitlab # [ 7.997837] logrotate[570]: log does not need rotating (log has already been rotated)831gitlab # [ 7.998790] logrotate[570]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed832gitlab # [ 8.004168] logrotate[570]: switching euid from 0 to 165 and egid from 0 to 165 (pid 570)833gitlab # [ 8.005252] logrotate[570]: considering log /var/gitlab/state/log/*.log834gitlab # [ 8.006078] logrotate[570]: log /var/gitlab/state/log/*.log does not exist -- skipping835gitlab # [ 8.007289] logrotate[570]: Creating new state836gitlab # [ 8.007918] logrotate[570]: switching euid from 165 to 0 and egid from 165 to 0 (pid 570)837gitlab # [ 8.011169] logrotate[570]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed838gitlab # [ 8.012982] logrotate[570]: switching euid from 0 to 60 and egid from 0 to 60 (pid 570)839gitlab # [ 8.014066] logrotate[570]: considering log /var/log/nginx/*.log840gitlab # [ 8.014856] logrotate[570]: log /var/log/nginx/*.log does not exist -- skipping841gitlab # [ 8.015817] logrotate[570]: Creating new state842gitlab # [ 8.024210] logrotate[570]: not running postrotate script, since no logs were rotated843gitlab # [ 8.025435] logrotate[570]: switching euid from 60 to 0 and egid from 60 to 0 (pid 570)844gitlab # [ 8.027132] nsncd[571]: Sep 01 10:32:04.837 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"845gitlab # [ 8.029405] systemd[1]: Starting resolvconf update...846gitlab # [ 8.030381] systemd[1]: Started Name Service Cache Daemon (nsncd).847gitlab # [ 8.031542] systemd[1]: Finished Logrotate configuration check.848gitlab # [ 8.032655] systemd[1]: Finished Post-Boot Actions.[ 8.038133] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3849gitlab # 850gitlab # [ 8.034758] systemd[1]: Reached target Host and Network Name Lookups.851gitlab # [ 8.035704] systemd[1]: Reached target User and Group Name Lookups.852gitlab # [ 8.039517] systemd[1]: Starting User Login Management...853gitlab # [ 8.040517] systemd[1]: Finished Import lastlog data into lastlog2 database.854gitlab # [ 8.098925] systemd-logind[605]: New seat seat0.855gitlab # [ 8.111358] systemd-logind[605]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)856gitlab # [ 8.116150] systemd-logind[605]: Watching system buttons on /dev/input/event0 (gpio-keys)857gitlab # [ 8.117764] systemd[1]: Started User Login Management.858gitlab # [ 8.122891] systemd[1]: Starting linger-users.service...859gitlab # [ 8.127490] systemd[1]: Starting Virtual Console Setup...860gitlab # [ 8.143724] systemd[1]: Stopped target Host and Network Name Lookups.861gitlab # [ 8.148323] systemd[1]: Stopping Host and Network Name Lookups...862gitlab # [ 8.149998] systemd[1]: Stopped target User and Group Name Lookups.863gitlab # [ 8.151006] systemd[1]: Stopping User and Group Name Lookups...864gitlab # [ 8.151865] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...865gitlab # [ 8.160857] systemd[1]: nscd.service: Deactivated successfully.866gitlab # [ 8.163720] systemd[1]: Stopped Name Service Cache Daemon (nsncd).867gitlab # [ 8.164776] systemd[1]: nscd.service: Consumed 26ms CPU time over 202ms wall clock time, 7.6M memory peak, 5.8M read from disk.868gitlab # [ 8.166405] systemd[1]: Starting Name Service Cache Daemon (nsncd)...869gitlab # [ 8.167418] systemd[1]: linger-users.service: Deactivated successfully.870gitlab # [ 8.169482] systemd[1]: Finished linger-users.service.871gitlab # [ 8.175837] systemd-logind[605]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)872gitlab # [ 8.191212] nsncd[665]: Sep 01 10:32:05.035 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"873gitlab # [ 8.194572] systemd[1]: Started Name Service Cache Daemon (nsncd).874gitlab # [ 8.196444] systemd[1]: Reached target Host and Network Name Lookups.875gitlab # [ 8.197397] systemd[1]: Reached target User and Group Name Lookups.876gitlab # [ 8.201016] systemd[1]: Finished resolvconf update.877gitlab # [ 8.202443] systemd[1]: Reached target Preparation for Network.878gitlab # [ 8.208163] systemd[1]: Starting DHCP Client...879gitlab # [ 8.210218] systemd[1]: Starting Address configuration of eth1...880gitlab # [ 8.216277] systemd-vconsole-setup[657]: Configuration of first virtual console was skipped, ignoring remaining ones.881gitlab # [ 8.242403] systemd[1]: Starting Extra networking commands....882gitlab # [ 8.248376] systemd[1]: Finished Virtual Console Setup.883gitlab # [ 8.277735] network-addresses-eth1-start[693]: adding address 192.168.1.1/24... done884gitlab # [ 8.281751] network-addresses-eth1-start[693]: adding address 2001:db8:1::1/64... done885gitlab # [ 8.290640] systemd[1]: Finished Address configuration of eth1.886gitlab # [ 8.335681] dhcpcd[712]: dhcpcd-10.3.2 starting887gitlab # [ 8.337659] systemd[1]: Finished Extra networking commands..888gitlab # [ 8.338949] dhcpcd[758]: dev: loaded udev889gitlab # [ 8.341597] systemd[1]: Reached target Network.890gitlab # [ 8.345063] systemd[1]: Starting gitlab-workhorse.service...891gitlab # [ 8.348833] systemd[1]: Starting Nginx Web Server...892gitlab # [ 8.360197] 8021q: 802.1Q VLAN Support v1.8893gitlab # [ 8.360644] 8021q: adding VLAN 0 to HW filter on device eth1894gitlab # [ 8.360243] systemd[1]: Starting PostgreSQL Server...895gitlab # [ 8.364643] systemd[1]: Starting Redis Server - redis-gitlab...896gitlab # [ 8.368129] systemd[1]: Starting Permit User Sessions...897gitlab # [ 8.384102] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.898gitlab # [ 8.406554] cfg80211: Loading compiled-in X.509 certificates for regulatory database899gitlab # [ 8.406218] systemd[1]: Finished Permit User Sessions.900gitlab # [ 8.413073] systemd[1]: Started Getty on tty1.901gitlab # [ 8.413856] systemd[1]: Reached target Login Prompts.902gitlab # [ 8.429193] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'903gitlab # [ 8.429721] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'904gitlab # [ 8.431464] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2905gitlab # [ 8.431778] cfg80211: failed to load regulatory.db906gitlab # [ 8.483112] 8021q: adding VLAN 0 to HW filter on device eth0907gitlab # [ 8.479999] dhcpcd[758]: eth0: waiting for carrier908gitlab # [ 8.485100] dhcpcd[758]: eth0: carrier acquired909gitlab # [ 8.496877] dhcpcd[758]: DUID 00:01:00:01:32:29:66:25:52:54:00:12:34:56910gitlab # [ 8.498160] dhcpcd[758]: eth0: IAID 00:12:34:56911gitlab # [ 8.498935] dhcpcd[758]: eth0: adding address fe80::5054:ff:fe12:3456912gitlab # [ 8.538559] nginx-pre-start[791]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok913gitlab # [ 8.543173] nginx-pre-start[791]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful914gitlab # [ 8.545643] systemd[1]: Started Nginx Web Server.915gitlab # [ 8.563639] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.916gitlab # [ 8.566111] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo917gitlab # [ 8.567282] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started918gitlab # [ 8.569605] systemd[1]: Started Redis Server - redis-gitlab.919gitlab # [ 8.570694] redis-server[788]: Configuration loaded920gitlab # [ 8.572037] redis[788]: monotonic clock: ARM CNTVCT @ 1000 ticks/us921gitlab # [ 8.573374] redis[788]: Running mode=standalone, port=0.922gitlab # [ 8.574457] redis[788]: Server initialized923gitlab # [ 8.575181] redis[788]: Ready to accept connections unix924gitlab # [ 8.576096] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.925gitlab # [ 8.595864] postgresql-pre-start[796]: The files belonging to this database system will be owned by user "postgres".926gitlab # [ 8.599861] postgresql-pre-start[796]: This user must also own the server process.927gitlab # [ 8.601277] postgresql-pre-start[796]: The database cluster will be initialized with locale "en_US.UTF-8".928gitlab # [ 8.602881] postgresql-pre-start[796]: The default database encoding has accordingly been set to "UTF8".929gitlab # [ 8.604168] postgresql-pre-start[796]: The default text search configuration will be set to "english".930gitlab # [ 8.605624] postgresql-pre-start[796]: Data page checksums are enabled.931gitlab # [ 8.606636] postgresql-pre-start[796]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok932gitlab # [ 8.608763] postgresql-pre-start[796]: creating subdirectories ... ok933gitlab # [ 8.609811] postgresql-pre-start[796]: selecting dynamic shared memory implementation ... posix934gitlab # [ 8.620186] dhcpcd[758]: eth0: soliciting a DHCP lease935gitlab # [ 8.637852] dhcpcd[758]: eth0: offered 10.0.2.15 from 10.0.2.2936gitlab # [ 8.649001] postgresql-pre-start[796]: selecting default "max_connections" ... 100937gitlab # [ 8.656499] dhcpcd[758]: eth0: probing address 10.0.2.15/24938gitlab # [ 8.714515] postgresql-pre-start[796]: selecting default "shared_buffers" ... 128MB939gitlab # [ 9.018117] systemd[1]: Started gitlab-workhorse.service.940gitlab # [ 9.231225] postgresql-pre-start[796]: selecting default time zone ... UTC941gitlab # [ 9.234984] postgresql-pre-start[796]: creating configuration files ... ok942gitlab # [ 9.480231] gitlab-workhorse[820]: time="2026-09-01T10:32:06Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4943gitlab # [ 9.485520] gitlab-workhorse[820]: time="2026-09-01T10:32:06Z" level=info msg="Using redis/go-redis"944gitlab # [ 9.489815] gitlab-workhorse[820]: time="2026-09-01T10:32:06Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix945gitlab # [ 9.495733] postgresql-pre-start[796]: running bootstrap script ... ok946gitlab # [ 10.104571] postgresql-pre-start[796]: performing post-bootstrap initialization ... ok947gitlab # [ 10.360910] postgresql-pre-start[796]: syncing data to disk ... ok948gitlab # [ 10.363790] postgresql-pre-start[796]: initdb: warning: enabling "trust" authentication for local connections949gitlab # [ 10.368330] postgresql-pre-start[796]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.950gitlab # [ 10.376095] postgresql-pre-start[796]: Success. You can now start the database server using:951gitlab # [ 10.379771] postgresql-pre-start[796]: pg_ctl -D /var/lib/postgresql/18 -l logfile start952gitlab # [ 10.440937] dhcpcd[758]: eth0: soliciting an IPv6 router953gitlab # [ 10.443586] dhcpcd[758]: eth0: Router Advertisement from fe80::2954gitlab # [ 10.446713] dhcpcd[758]: eth0: adding address fec0::5054:ff:fe12:3456/64955gitlab # [ 10.449878] dhcpcd[758]: eth0: adding route to fec0::/64956gitlab # [ 10.452449] dhcpcd[758]: eth0: adding default route via fe80::2957gitlab # [ 10.595956] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit958gitlab # [ 10.601863] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432959gitlab # [ 10.605565] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432960gitlab # [ 10.609433] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"961gitlab # [ 10.616934] postgres[863]: [863] LOG: database system was shut down at 2026-09-01 10:32:06 GMT962gitlab # [ 10.626528] postgres[854]: [854] LOG: database system is ready to accept connections963gitlab # [ 10.631229] systemd[1]: Started PostgreSQL Server.964gitlab # [ 10.642081] systemd[1]: Starting PostgreSQL Setup Scripts...965gitlab # [ 11.124980] postgresql-setup-start[874]: CREATE DATABASE966gitlab # [ 11.180674] postgresql-setup-start[884]: CREATE ROLE967gitlab # [ 11.203243] postgresql-setup-start[886]: ALTER DATABASE968gitlab # [ 11.266658] postgresql-setup-start[891]: CREATE ROLE969gitlab # [ 11.272625] systemd[1]: Finished PostgreSQL Setup Scripts.970gitlab # [ 11.275352] systemd[1]: Reached target PostgreSQL.971gitlab # [ 11.278832] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[879]: mkdir -p /var/gitlab/state/home/.ssh: OK972gitlab # [ 11.283064] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[879]: chmod 700 /var/gitlab/state/home/.ssh: OK973gitlab # [ 11.287709] systemd[1]: Starting gitlab-postgresql.service...974gitlab # [ 11.383307] systemd[1]: Finished gitlab-config.service.975gitlab # [ 11.392304] systemd[1]: Started gitaly.service.976gitlab # [ 11.397508] systemd[1]: Starting gitlab-db-config.service...977gitlab # [ 11.435519] gitlab-postgresql-start[915]: CREATE DATABASE978gitlab # [ 11.505056] gitlab-postgresql-start[928]: CREATE EXTENSION979gitlab # [ 11.606790] gitlab-postgresql-start[931]: CREATE EXTENSION980gitlab # [ 11.611879] systemd[1]: Finished gitlab-postgresql.service.981gitlab # [ 12.173299] gitaly[922]: time="2026-09-01T10:32:09.017Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=922982gitlab # [ 12.184313] gitaly[922]: time="2026-09-01T10:32:09.017Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=922983gitlab # [ 12.187001] gitaly[922]: time="2026-09-01T10:32:09.017Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=922984gitlab # [ 12.190422] gitaly[922]: time="2026-09-01T10:32:09.017Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=922985gitlab # [ 12.193365] gitaly[922]: time="2026-09-01T10:32:09.017Z" level=info msg="Starting Gitaly" pid=922 version=986gitlab # [ 12.485614] gitaly[922]: time="2026-09-01T10:32:09.330Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=311 pid=922987gitlab # [ 12.488260] gitaly[922]: time="2026-09-01T10:32:09.330Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=922988gitlab # [ 12.491001] gitaly[922]: time="2026-09-01T10:32:09.330Z" level=info msg="finished initializing command factory" duration_ms=0 pid=922989gitlab # [ 12.493629] gitaly[922]: time="2026-09-01T10:32:09.330Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-922/git-exec-2266603013.d/git pid=922990gitlab # [ 12.496543] gitaly[922]: time="2026-09-01T10:32:09.340Z" level=info msg="finished detecting git version" duration_ms=9 pid=922991gitlab # [ 12.499144] gitaly[922]: time="2026-09-01T10:32:09.340Z" level=info msg="using Git version" pid=922 version=2.53.g992gitlab # [ 12.501368] gitaly[922]: time="2026-09-01T10:32:09.340Z" level=info msg="clearing disk cache object folder" pid=922 storage=default993gitlab # [ 12.503829] gitaly[922]: time="2026-09-01T10:32:09.341Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache97281893 pid=922 storage=default994gitlab # [ 12.507716] gitaly[922]: time="2026-09-01T10:32:09.341Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache97281893 pid=922 storage=default995gitlab # [ 12.512355] gitaly[922]: time="2026-09-01T10:32:09.341Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=922996gitlab # [ 12.516351] gitaly[922]: time="2026-09-01T10:32:09.341Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=922997gitlab # [ 12.520779] gitaly[922]: time="2026-09-01T10:32:09.341Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache97281893 clear_duration_ms=0 pid=922 storage=default998gitlab # [ 12.526773] gitaly[922]: time="2026-09-01T10:32:09.371Z" level=info msg="counting repositories" pid=922999gitlab # [ 12.529014] gitaly[922]: time="2026-09-01T10:32:09.371Z" level=info msg="starting to count repositories" pid=922 storage_path=/var/gitlab/state/repositories1000gitlab # [ 12.532115] gitaly[922]: time="2026-09-01T10:32:09.371Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=922 storage_path=/var/gitlab/state/repositories1001gitlab # [ 12.535656] gitaly[922]: time="2026-09-01T10:32:09.371Z" level=info msg="finished tempdir cleaner walk" pid=922 storage=default time_ms=01002gitlab # [ 12.538942] gitaly[922]: time="2026-09-01T10:32:09.371Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9221003gitlab # [ 12.542400] gitaly[922]: time="2026-09-01T10:32:09.371Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9221004gitlab # [ 12.546700] gitaly[922]: time="2026-09-01T10:32:09.371Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=922 schema=unix1005gitlab # [ 12.550464] gitaly[922]: time="2026-09-01T10:32:09.371Z" level=info msg="listening at address" address=/run/gitaly/gitaly-922/sock.d/intern pid=922 schema=unix1006gitlab # [ 12.554525] gitaly[922]: time="2026-09-01T10:32:09.373Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9221007gitlab # [ 12.557852] gitaly[922]: time="2026-09-01T10:32:09.373Z" level=info msg="Started Gitaly" duration_ms=356 pid=9221008gitlab # [ 12.560314] gitaly[922]: time="2026-09-01T10:32:09.374Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9221009gitlab # [ 12.563340] gitaly[922]: time="2026-09-01T10:32:09.374Z" level=info msg="maintenance: daily scheduled" pid=922 scheduled="2026-09-01 12:00:00 +0000 UTC"1010gitlab # [ 12.752124] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 12.761534] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 12.777082] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 14.246806] dhcpcd[758]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 14.248245] dhcpcd[758]: eth0: adding route to 10.0.2.0/241015gitlab # [ 14.250873] dhcpcd[758]: eth0: adding default route via 10.0.2.21016gitlab # [ 14.375899] systemd[1]: Started DHCP Client.1017gitlab # [ 14.377987] systemd[1]: Reached target Network is Online.1018gitlab # [ 16.160624] gitaly[922]: time="2026-09-01T10:32:13.003Z" level=info msg="License database preloaded" duration_ms=3985 pid=9221019gitlab # [ 58.488112] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[926]: W, [2026-09-01T10:32:55.331174 #926] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1020gitlab # [ 59.560915] gitlab-workhorse[820]: time="2026-09-01T10:32:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1021gitlab # [ 61.766501] postgres[1449]: [1449] ERROR: relation "feature_gates" does not exist at character 5231022gitlab # [ 61.766904] postgres[1449]: [1449] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1023gitlab # [ 61.767029] postgres[1449]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1024gitlab # [ 61.767144] postgres[1449]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1025gitlab # [ 61.767256] postgres[1449]: attidentity AS identity,1026gitlab # [ 61.767368] postgres[1449]: attgenerated as attgenerated1027gitlab # [ 61.767467] postgres[1449]: FROM pg_attribute a1028gitlab # [ 61.767578] postgres[1449]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1029gitlab # [ 61.767711] postgres[1449]: LEFT JOIN pg_type t ON a.atttypid = t.oid1030gitlab # [ 61.767823] postgres[1449]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1031gitlab # [ 61.767937] postgres[1449]: WHERE a.attrelid = '"feature_gates"'::regclass1032gitlab # [ 61.800955] postgres[1449]: AND a.attnum > 0 AND NOT a.attisdropped1033gitlab # [ 61.803660] postgres[1449]: ORDER BY a.attnum1034gitlab # [ 61.806789] postgres[1449]:1035gitlab # [ 67.125386] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1500]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 67.128583] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1500]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 69.570349] gitlab-workhorse[820]: time="2026-09-01T10:33:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 79.577584] gitlab-workhorse[820]: time="2026-09-01T10:33:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 89.585971] gitlab-workhorse[820]: time="2026-09-01T10:33:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 93.239735] postgres[1603]: [1603] ERROR: relation "table_without_models" does not exist1041gitlab # [ 93.243443] postgres[1603]: [1603] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1042gitlab # [ 99.596994] gitlab-workhorse[820]: time="2026-09-01T10:33:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 109.606554] gitlab-workhorse[820]: time="2026-09-01T10:33:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 119.614186] gitlab-workhorse[820]: time="2026-09-01T10:33:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 124.916688] systemd[1]: Finished gitlab-db-config.service.1046gitlab # [ 124.922516] systemd[1]: Started gitlab-sidekiq.service.1047gitlab # [ 124.928594] systemd[1]: Starting gitlab.service...1048gitlab # [ 125.555746] bundle[1987]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1049gitlab # [ 125.556321] bundle[1987]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1050gitlab # [ 125.558022] bundle[1987]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1051gitlab # [ 129.619241] gitlab-workhorse[820]: time="2026-09-01T10:34:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1052gitlab # [ 130.528534] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-01T10:34:07.322Z","message":"Starting cluster with 1 processes"}1053gitlab # [ 130.604119] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.405Z","pid":1987,"message":"* Enabling systemd notification integration"}1054gitlab # [ 130.609669] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.447Z","pid":1987,"message":"Puma starting in cluster mode..."}1055gitlab # [ 130.614398] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.447Z","pid":1987,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1056gitlab # [ 130.619591] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.447Z","pid":1987,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1057gitlab # [ 130.625911] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.447Z","pid":1987,"message":"* Min threads: 0"}1058gitlab # [ 130.630108] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.447Z","pid":1987,"message":"* Max threads: 4"}1059gitlab # [ 130.633999] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.447Z","pid":1987,"message":"* Environment: production"}1060gitlab # [ 130.638272] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.447Z","pid":1987,"message":"* Master PID: 1987"}1061gitlab # [ 130.642256] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.447Z","pid":1987,"message":"* Workers: 2"}1062gitlab # [ 130.646459] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.447Z","pid":1987,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1063gitlab # [ 130.652640] bundle[1987]: {"timestamp":"2026-09-01T10:34:07.448Z","pid":1987,"message":"* Preloading application"}1064gitlab # [ 139.621751] gitlab-workhorse[820]: time="2026-09-01T10:34:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 149.628952] gitlab-workhorse[820]: time="2026-09-01T10:34:26Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 159.638738] gitlab-workhorse[820]: time="2026-09-01T10:34:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 169.646355] gitlab-workhorse[820]: time="2026-09-01T10:34:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 172.754875] bundle[1987]: W, [2026-09-01T10:34:49.598417 #1987] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1069gitlab # [ 179.658921] gitlab-workhorse[820]: time="2026-09-01T10:34:56Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1070gitlab # [ 179.881709] sidekiq-cluster[2046]: 2026-09-01T10:34:56.723Z pid=2046 tid=wnq INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2046, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432836608}1071gitlab # [ 180.418573] sidekiq-cluster[2046]: W, [2026-09-01T10:34:57.262788 #2046] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1072gitlab # [ 180.525328] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:34:57.369Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1073gitlab # [ 186.887830] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.730Z","message":"GitLab reliable fetch activated!"}1074gitlab # [ 186.893191] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.730Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1075gitlab # [ 186.927508] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.771Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1076gitlab # [ 186.934718] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.775Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1077gitlab # [ 186.941910] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.778Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1078gitlab # [ 186.948795] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.781Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1079gitlab # [ 186.956345] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.785Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1080gitlab # [ 186.962913] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.788Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1081gitlab # [ 186.968793] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.791Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1082gitlab # [ 186.973876] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.793Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1083gitlab # [ 186.978522] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.796Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1084gitlab # [ 186.982977] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.798Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1085gitlab # [ 186.987595] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.801Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1086gitlab # [ 186.991687] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.804Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1087gitlab # [ 186.995263] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.807Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1088gitlab # [ 186.998920] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.809Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1089gitlab # [ 187.002579] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.811Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1090gitlab # [ 187.005914] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.814Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1091gitlab # [ 187.008894] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.817Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1092gitlab # [ 187.011680] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.820Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1093gitlab # [ 187.014724] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.824Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1094gitlab # [ 187.017667] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.827Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1095gitlab # [ 187.020586] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.830Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1096gitlab # [ 187.023518] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.833Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1097gitlab # [ 187.026173] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.836Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1098gitlab # [ 187.028761] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.839Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1099gitlab # [ 187.031304] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.841Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1100gitlab # [ 187.033744] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.844Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1101gitlab # [ 187.035990] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.848Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1102gitlab # [ 187.038253] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.852Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1103gitlab # [ 187.040639] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.856Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1104gitlab # [ 187.043002] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.860Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1105gitlab # [ 187.045246] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.863Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1106gitlab # [ 187.047617] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.866Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1107gitlab # [ 187.049830] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.870Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1108gitlab # [ 187.052042] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.874Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1109gitlab # [ 187.054113] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.877Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1110gitlab # [ 187.056267] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.879Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1111gitlab # [ 187.058343] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.881Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1112gitlab # [ 187.060389] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.884Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1113gitlab # [ 187.062438] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.887Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1114gitlab # [ 187.064470] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.890Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1115gitlab # [ 187.066611] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.892Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1116gitlab # [ 187.068778] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.894Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1117gitlab # [ 187.070866] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.897Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1118gitlab # [ 187.073008] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.899Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1119gitlab # [ 187.075187] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.902Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1120gitlab # [ 187.077508] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.904Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1121gitlab # [ 187.079645] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.906Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1122gitlab # [ 187.081909] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.909Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1123gitlab # [ 187.083992] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.911Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1124gitlab # [ 187.086092] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.914Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1125gitlab # [ 187.088281] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.916Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1126gitlab # [ 187.091411] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.919Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1127gitlab # [ 187.093695] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.928Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1128gitlab # [ 187.096101] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.932Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1129gitlab # [ 187.098280] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.934Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1130gitlab # [ 187.100537] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.937Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1131gitlab # [ 187.102923] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.940Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1132gitlab # [ 187.105626] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.942Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1133gitlab # [ 187.108088] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.945Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1134gitlab # [ 187.110490] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.948Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1135gitlab # [ 187.112703] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.950Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1136gitlab # [ 187.114841] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.952Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1137gitlab # [ 187.117498] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.956Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1138gitlab # [ 187.119833] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.960Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1139gitlab # [ 187.122400] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.963Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1140gitlab # [ 187.124782] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.966Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1141gitlab # [ 187.126975] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.968Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1142gitlab # [ 187.129398] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.969Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1143gitlab # [ 187.131816] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.971Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1144gitlab # [ 187.134251] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.973Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1145gitlab # [ 187.136539] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.975Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1146gitlab # [ 187.138807] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.978Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1147gitlab # [ 187.141120] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.980Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1148gitlab # [ 187.143509] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.982Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1149gitlab # [ 187.146103] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.984Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1150gitlab # [ 187.148460] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.986Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1151gitlab # [ 187.150669] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.989Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1152gitlab # [ 187.153346] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.991Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1153gitlab # [ 187.155585] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.993Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1154gitlab # [ 187.157859] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.995Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1155gitlab # [ 187.160182] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.997Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1156gitlab # [ 187.162603] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:03.999Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1157gitlab # [ 187.164956] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.002Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1158gitlab # [ 187.167144] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.004Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1159gitlab # [ 187.169592] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.007Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1160gitlab # [ 187.171768] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.009Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1161gitlab # [ 187.174366] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.012Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1162gitlab # [ 187.176694] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.014Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1163gitlab # [ 187.178973] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.017Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1164gitlab # [ 187.181322] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.020Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1165gitlab # [ 187.183621] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.022Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1166gitlab # [ 187.185995] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.025Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1167gitlab # [ 187.188305] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.027Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1168gitlab # [ 187.190715] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.030Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1169gitlab # [ 187.192736] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.033Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1170gitlab # [ 187.195061] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.036Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1171gitlab # [ 187.197426] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.039Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1172gitlab # [ 187.199738] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.042Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1173gitlab # [ 187.209273] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.053Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1174gitlab # [ 187.212365] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.056Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1175gitlab # [ 187.214856] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.059Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1176gitlab # [ 187.219099] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.063Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1177gitlab # [ 187.222482] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.066Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1178gitlab # [ 187.225724] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.070Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1179gitlab # [ 187.229615] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.073Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1180gitlab # [ 187.236263] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.079Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1181gitlab # [ 187.238587] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.081Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1182gitlab # [ 187.241334] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.084Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1183gitlab # [ 187.243664] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:04.086Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1184gitlab # [ 189.658299] gitlab-workhorse[820]: time="2026-09-01T10:35:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 199.666557] gitlab-workhorse[820]: time="2026-09-01T10:35:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 209.669896] gitlab-workhorse[820]: time="2026-09-01T10:35:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 219.679671] gitlab-workhorse[820]: time="2026-09-01T10:35:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 229.688451] gitlab-workhorse[820]: time="2026-09-01T10:35:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1189gitlab # [ 237.158673] postgres[2929]: [2929] ERROR: relation "table_without_models" does not exist1190gitlab # [ 237.159298] postgres[2929]: [2929] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 238.219728] postgres[2940]: [2940] ERROR: relation "table_without_models" does not exist1192gitlab # [ 238.220140] postgres[2940]: [2940] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1193gitlab # [ 239.698330] gitlab-workhorse[820]: time="2026-09-01T10:35:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1194gitlab # [ 242.309401] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:59.150Z","message":"Booted Rails 7.2.3.1 application in production environment"}1195gitlab # [ 242.312849] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:59.157Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1196gitlab # [ 242.322406] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:59.159Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1197gitlab # [ 242.329078] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:59.160Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1198gitlab # [ 242.335441] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:35:59.162Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1199gitlab # [ 245.189745] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:02.032Z","message":"Cleaning working queues"}1200gitlab # [ 245.194554] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:02.037Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e891173202d35ad2e13186b2","created_at":"2026-09-01T10:34:00.890Z","trace_propagation_headers":{"sentry-trace":"9120ca61a1174760905ed4dbf1a75dd2-086c84b1b4634286","baggage":"sentry-trace_id=9120ca61a1174760905ed4dbf1a75dd2,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"36e20fcd258613033208c437402cfef8","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:00.901Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e891173202d35ad2e13186b2: start","job_status":"start","queue_duration_s":121.135384,"scheduling_latency_s":121.135449}1201gitlab # [ 245.532393] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:02.375Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e891173202d35ad2e13186b2","created_at":"2026-09-01T10:34:00.890Z","trace_propagation_headers":{"sentry-trace":"9120ca61a1174760905ed4dbf1a75dd2-086c84b1b4634286","baggage":"sentry-trace_id=9120ca61a1174760905ed4dbf1a75dd2,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"36e20fcd258613033208c437402cfef8","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:34:00.901Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e891173202d35ad2e13186b2: done: 0.33853 sec","job_status":"done","queue_duration_s":121.135384,"scheduling_latency_s":121.135449,"redis_calls":28,"redis_duration_s":0.01501,"redis_read_bytes":408,"redis_write_bytes":3436,"redis_feature_flag_calls":17,"redis_feature_flag_duration_s":0.009367,"redis_feature_flag_read_bytes":398,"redis_feature_flag_write_bytes":2189,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003417,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002226,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":14,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":13,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.189244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.17583754000000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.33853,"completed_at":"2026-09-01T10:36:02.375Z","load_balancing_strategy":"primary","db_duration_s":0.099301,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1202gitlab # [ 245.650250] bundle[1987]: {"timestamp":"2026-09-01T10:36:02.430Z","pid":1987,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1203gitlab # [ 245.654534] bundle[1987]: {"timestamp":"2026-09-01T10:36:02.430Z","pid":1987,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1204gitlab # [ 245.658317] bundle[1987]: {"timestamp":"2026-09-01T10:36:02.430Z","pid":1987,"message":"! #\u003cThread:0x0000e4bdd84338b8 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1205gitlab # [ 245.670040] bundle[1987]: {"timestamp":"2026-09-01T10:36:02.430Z","pid":1987,"message":"! #\u003cThread:0x0000e4bdd7d12570 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1206gitlab # [ 245.681022] bundle[1987]: {"timestamp":"2026-09-01T10:36:02.430Z","pid":1987,"message":"Use Ctrl-C to stop"}1207gitlab # [ 245.683510] bundle[1987]: {"timestamp":"2026-09-01T10:36:02.431Z","pid":1987,"message":"Sending status to systemd every 1.0 sec"}1208gitlab # [ 246.356232] bundle[1987]: {"timestamp":"2026-09-01T10:36:03.200Z","pid":1987,"message":"- Worker 0 (PID: 3066) booted in 0.71s, phase: 0"}1209gitlab # [ 246.446265] bundle[1987]: {"timestamp":"2026-09-01T10:36:03.290Z","pid":1987,"message":"- Worker 1 (PID: 3070) booted in 0.76s, phase: 0"}1210gitlab # [ 246.456173] systemd[1]: Started gitlab.service.1211gitlab # [ 246.460726] systemd[1]: Reached target Common target for all GitLab services..1212gitlab # [ 246.467780] systemd[1]: Starting setup-gitlab.service...1213gitlab # [ 246.528609] setup-gitlab-start[3103]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1214gitlab # [ 250.670417] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:36:07 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 40831215gitlab # [ 250.675148] setup-gitlab-start[3103]: + TOKEN=nixbot-test-token-of-20-chars1216gitlab # [ 250.676560] setup-gitlab-start[3103]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1217gitlab # [ 250.694226] runuser[3133]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1218gitlab # [ 251.255727] setup-gitlab-start[3135]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1219gitlab # [ 251.259714] setup-gitlab-start[3135]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1220gitlab # [ 251.266296] setup-gitlab-start[3135]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1221gitlab # [ 252.166766] setup-gitlab-start[3135]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1222gitlab # [ 252.167148] setup-gitlab-start[3135]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1223gitlab # [ 252.170002] setup-gitlab-start[3135]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1224gitlab # [ 257.551481] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:14.393Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7def5d022627f6fcaf74a3b8","created_at":"2026-09-01T10:36:14.296Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9338cd201bbc2c05395387c2c7ca19b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.390Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7def5d022627f6fcaf74a3b8: start","job_status":"start","queue_duration_s":0.003404,"scheduling_latency_s":0.003465}1225gitlab # [ 257.727306] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:14.571Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1226gitlab # [ 257.774288] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:14.617Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7def5d022627f6fcaf74a3b8","created_at":"2026-09-01T10:36:14.296Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9338cd201bbc2c05395387c2c7ca19b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.390Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7def5d022627f6fcaf74a3b8: done: 0.223872 sec","job_status":"done","queue_duration_s":0.003404,"scheduling_latency_s":0.003465,"redis_calls":10,"redis_duration_s":0.027663,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00624,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00380842,"duration_s":0.223872,"completed_at":"2026-09-01T10:36:14.617Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 257.865774] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:14.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ca1aadb88c7b9867dd899ad3","created_at":"2026-09-01T10:36:14.409Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"263064f3dff299597dd3905a9c5e519e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:36:14.423Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ca1aadb88c7b9867dd899ad3: start","job_status":"start","queue_duration_s":0.262011,"scheduling_latency_s":0.262068}1228gitlab # [ 257.910136] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:14.754Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1229gitlab # [ 257.975217] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:14.816Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ca1aadb88c7b9867dd899ad3","created_at":"2026-09-01T10:36:14.409Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"263064f3dff299597dd3905a9c5e519e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:36:14.423Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ca1aadb88c7b9867dd899ad3: done: 0.130888 sec","job_status":"done","queue_duration_s":0.262011,"scheduling_latency_s":0.262068,"redis_calls":10,"redis_duration_s":0.029098,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004996,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.021543,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002559,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00152002,"duration_s":0.130888,"completed_at":"2026-09-01T10:36:14.816Z","load_balancing_strategy":"primary","db_duration_s":0.006171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 258.054489] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:14.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ef3a3231b97ad13de61e44dd","created_at":"2026-09-01T10:36:14.428Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c329b635f4b5fa31d90c777e834d780","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:36:14.438Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ef3a3231b97ad13de61e44dd: start","job_status":"start","queue_duration_s":0.385369,"scheduling_latency_s":0.385428}1231gitlab # [ 258.117378] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:14.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ef3a3231b97ad13de61e44dd","created_at":"2026-09-01T10:36:14.428Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c329b635f4b5fa31d90c777e834d780","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:36:14.438Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ef3a3231b97ad13de61e44dd: done: 0.13715 sec","job_status":"done","queue_duration_s":0.385369,"scheduling_latency_s":0.385428,"redis_calls":10,"redis_duration_s":0.016869,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002194,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013059,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001616,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038404,"duration_s":0.13715,"completed_at":"2026-09-01T10:36:14.960Z","load_balancing_strategy":"primary","db_duration_s":0.046931,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 258.183138] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:14.991Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fd91c100a4bc1fcbd844047c","created_at":"2026-09-01T10:36:14.445Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57e773fd18a5f995745a5bd2f9aaa8e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.471Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fd91c100a4bc1fcbd844047c: start","job_status":"start","queue_duration_s":0.519246,"scheduling_latency_s":0.519276}1233gitlab # [ 258.252739] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:15.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fd91c100a4bc1fcbd844047c","created_at":"2026-09-01T10:36:14.445Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57e773fd18a5f995745a5bd2f9aaa8e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.471Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fd91c100a4bc1fcbd844047c: done: 0.104595 sec","job_status":"done","queue_duration_s":0.519246,"scheduling_latency_s":0.519276,"redis_calls":12,"redis_duration_s":0.0032630000000000003,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001121,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000552,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052952,"duration_s":0.104595,"completed_at":"2026-09-01T10:36:15.095Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 258.331871] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:15.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f5f4d1ce1ff3b87ba70af94b","created_at":"2026-09-01T10:36:14.506Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.526Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f5f4d1ce1ff3b87ba70af94b: start","job_status":"start","queue_duration_s":0.588821,"scheduling_latency_s":0.588874}1235gitlab # [ 258.487853] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:15.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f5f4d1ce1ff3b87ba70af94b","created_at":"2026-09-01T10:36:14.506Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.526Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f5f4d1ce1ff3b87ba70af94b: done: 0.215205 sec","job_status":"done","queue_duration_s":0.588821,"scheduling_latency_s":0.588874,"redis_calls":19,"redis_duration_s":0.038163,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005702,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001559,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.027163,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003739,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00266306,"duration_s":0.215205,"completed_at":"2026-09-01T10:36:15.330Z","load_balancing_strategy":"primary","db_duration_s":0.013553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 258.577927] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:15.350Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"06ba1cb8fc08981aa8c5a2ae","created_at":"2026-09-01T10:36:14.568Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e96c568dc87de84f268cc0bf53b42daa","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.589Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-06ba1cb8fc08981aa8c5a2ae: start","job_status":"start","queue_duration_s":0.761372,"scheduling_latency_s":0.761437}1237gitlab # [ 258.741206] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:15.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"06ba1cb8fc08981aa8c5a2ae","created_at":"2026-09-01T10:36:14.568Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e96c568dc87de84f268cc0bf53b42daa","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.589Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-06ba1cb8fc08981aa8c5a2ae: done: 0.232902 sec","job_status":"done","queue_duration_s":0.761372,"scheduling_latency_s":0.761437,"redis_calls":12,"redis_duration_s":0.031438,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00803,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00973,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00335202,"exclusive_lock_hold_duration_s":0.02046088,"duration_s":0.232902,"completed_at":"2026-09-01T10:36:15.583Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 258.833201] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:15.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d60162fa19ce785b48e80e87","created_at":"2026-09-01T10:36:14.610Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8351d244f55236b70eac28d427ae14a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.684Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d60162fa19ce785b48e80e87: start","job_status":"start","queue_duration_s":0.905164,"scheduling_latency_s":0.905222}1239gitlab # [ 258.850140] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:15.657Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d60162fa19ce785b48e80e87","created_at":"2026-09-01T10:36:14.610Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8351d244f55236b70eac28d427ae14a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.684Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d60162fa19ce785b48e80e87: done: 0.068104 sec","job_status":"done","queue_duration_s":0.905164,"scheduling_latency_s":0.905222,"redis_calls":10,"redis_duration_s":0.004484999999999999,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000819,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00100144,"duration_s":0.068104,"completed_at":"2026-09-01T10:36:15.657Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 258.898587] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:15.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c518ff0c336fd195746320c3","created_at":"2026-09-01T10:36:14.731Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"415fcf9b3fd4b0c6ef1fe9ddf56e4729","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.757Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c518ff0c336fd195746320c3: start","job_status":"start","queue_duration_s":0.904214,"scheduling_latency_s":0.904262}1241gitlab # [ 259.242703] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.086Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c518ff0c336fd195746320c3","created_at":"2026-09-01T10:36:14.731Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"415fcf9b3fd4b0c6ef1fe9ddf56e4729","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.757Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c518ff0c336fd195746320c3: done: 0.424927 sec","job_status":"done","queue_duration_s":0.904214,"scheduling_latency_s":0.904262,"redis_calls":14,"redis_duration_s":0.005201,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001604,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001881,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001716,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.082,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.082,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.31734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0012,"exclusive_lock_hold_duration_s":0.37696482,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.424927,"completed_at":"2026-09-01T10:36:16.086Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.116927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 259.344626] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.088Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6aebcd684549287c5b25faf0","created_at":"2026-09-01T10:36:14.800Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"573cf4e9a07e4a4410fc9d4b60bfaff2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.835Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6aebcd684549287c5b25faf0: start","job_status":"start","queue_duration_s":1.253737,"scheduling_latency_s":1.253764}1243gitlab # [ 259.363439] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.106Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1244gitlab # [ 259.368065] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6aebcd684549287c5b25faf0","created_at":"2026-09-01T10:36:14.800Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"573cf4e9a07e4a4410fc9d4b60bfaff2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.835Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6aebcd684549287c5b25faf0: done: 0.028283 sec","job_status":"done","queue_duration_s":1.253737,"scheduling_latency_s":1.253764,"redis_calls":10,"redis_duration_s":0.003574,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000702,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045228,"duration_s":0.028283,"completed_at":"2026-09-01T10:36:16.116Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001009,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 259.413347] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.118Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b93731c639b7f2b9ae2b8b24","created_at":"2026-09-01T10:36:14.874Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"025921eff729874051bfdd3d2104c7a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.890Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b93731c639b7f2b9ae2b8b24: start","job_status":"start","queue_duration_s":1.227767,"scheduling_latency_s":1.227786}1246gitlab # [ 259.428974] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b93731c639b7f2b9ae2b8b24","created_at":"2026-09-01T10:36:14.874Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"025921eff729874051bfdd3d2104c7a6","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.890Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b93731c639b7f2b9ae2b8b24: done: 0.07515 sec","job_status":"done","queue_duration_s":1.227767,"scheduling_latency_s":1.227786,"redis_calls":12,"redis_duration_s":0.004574,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001137,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00171,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00098958,"exclusive_lock_hold_duration_s":0.02581998,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.07515,"completed_at":"2026-09-01T10:36:16.193Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 259.477700] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.196Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"851514391c0a0d047cd0c9b8","created_at":"2026-09-01T10:36:14.901Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffd7e2bc5d6a580fa4ea6cd30f75b9a0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.926Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-851514391c0a0d047cd0c9b8: start","job_status":"start","queue_duration_s":1.269795,"scheduling_latency_s":1.269819}1248gitlab # [ 259.492810] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.250Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"851514391c0a0d047cd0c9b8","created_at":"2026-09-01T10:36:14.901Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffd7e2bc5d6a580fa4ea6cd30f75b9a0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.926Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-851514391c0a0d047cd0c9b8: done: 0.054299 sec","job_status":"done","queue_duration_s":1.269795,"scheduling_latency_s":1.269819,"redis_calls":16,"redis_duration_s":0.006353,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003733,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00065,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046962,"duration_s":0.054299,"completed_at":"2026-09-01T10:36:16.250Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 259.535523] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.253Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ee7d45b38bb5bf6588470c8a","created_at":"2026-09-01T10:36:14.931Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a27d23dee191d3fde8ee2bd52e1d840","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.956Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ee7d45b38bb5bf6588470c8a: start","job_status":"start","queue_duration_s":1.296447,"scheduling_latency_s":1.296477}1250gitlab # [ 259.548984] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.289Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ee7d45b38bb5bf6588470c8a","created_at":"2026-09-01T10:36:14.931Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a27d23dee191d3fde8ee2bd52e1d840","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:14.956Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ee7d45b38bb5bf6588470c8a: done: 0.036384 sec","job_status":"done","queue_duration_s":1.296447,"scheduling_latency_s":1.296477,"redis_calls":12,"redis_duration_s":0.005527,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00085,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001152,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046158,"duration_s":0.036384,"completed_at":"2026-09-01T10:36:16.289Z","load_balancing_strategy":"primary","db_duration_s":0.000913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 259.591254] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.292Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"5a5f9b2c1731fd4e677dbc32","created_at":"2026-09-01T10:36:14.989Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c1cc2ccc6f4c94e87bc5c8b48c827a2","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.003Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-5a5f9b2c1731fd4e677dbc32: start","job_status":"start","queue_duration_s":1.289255,"scheduling_latency_s":1.289291}1252gitlab # [ 259.605663] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"5a5f9b2c1731fd4e677dbc32","created_at":"2026-09-01T10:36:14.989Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c1cc2ccc6f4c94e87bc5c8b48c827a2","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.003Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-5a5f9b2c1731fd4e677dbc32: done: 0.053999 sec","job_status":"done","queue_duration_s":1.289255,"scheduling_latency_s":1.289291,"redis_calls":10,"redis_duration_s":0.003941,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000879,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000796,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068772,"duration_s":0.053999,"completed_at":"2026-09-01T10:36:16.346Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009098,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 259.647473] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.349Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"969f38d62e508da8c54df1cf","created_at":"2026-09-01T10:36:15.010Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94638fc7722c8ead74ca83eb7d8cdd20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.047Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-969f38d62e508da8c54df1cf: start","job_status":"start","queue_duration_s":1.301694,"scheduling_latency_s":1.301729}1254gitlab # [ 259.661853] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"969f38d62e508da8c54df1cf","created_at":"2026-09-01T10:36:15.010Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94638fc7722c8ead74ca83eb7d8cdd20","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.047Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-969f38d62e508da8c54df1cf: done: 0.034497 sec","job_status":"done","queue_duration_s":1.301694,"scheduling_latency_s":1.301729,"redis_calls":12,"redis_duration_s":0.004326,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000816,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044364,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.034497,"completed_at":"2026-09-01T10:36:16.383Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 259.709754] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"59490f09de5fbf3f22d3c3e6","created_at":"2026-09-01T10:36:15.087Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6a3758f7f23f4e1155e8c4fdecc3a65","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:36:15.100Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-59490f09de5fbf3f22d3c3e6: start","job_status":"start","queue_duration_s":1.28542,"scheduling_latency_s":1.285446}1256gitlab # [ 259.724421] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.401Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1257gitlab # [ 259.727995] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.409Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"59490f09de5fbf3f22d3c3e6","created_at":"2026-09-01T10:36:15.087Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6a3758f7f23f4e1155e8c4fdecc3a65","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:36:15.100Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-59490f09de5fbf3f22d3c3e6: done: 0.023585 sec","job_status":"done","queue_duration_s":1.28542,"scheduling_latency_s":1.285446,"redis_calls":10,"redis_duration_s":0.0026420000000000003,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000602,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034076,"duration_s":0.023585,"completed_at":"2026-09-01T10:36:16.409Z","load_balancing_strategy":"primary","db_duration_s":0.000989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 259.769889] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"09da7135c0ebd3ef37722712","created_at":"2026-09-01T10:36:15.108Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50f41ffd5da94cee422378a4101af8a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.122Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-09da7135c0ebd3ef37722712: start","job_status":"start","queue_duration_s":1.288457,"scheduling_latency_s":1.288475}1259gitlab # [ 259.784877] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"09da7135c0ebd3ef37722712","created_at":"2026-09-01T10:36:15.108Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50f41ffd5da94cee422378a4101af8a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.122Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-09da7135c0ebd3ef37722712: done: 0.046279 sec","job_status":"done","queue_duration_s":1.288457,"scheduling_latency_s":1.288475,"redis_calls":20,"redis_duration_s":0.0060999999999999995,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003237,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000409,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001687,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033818,"duration_s":0.046279,"completed_at":"2026-09-01T10:36:16.457Z","load_balancing_strategy":"primary","db_duration_s":0.003762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 259.828963] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"5ea5c6c1238df7716578c8f8","created_at":"2026-09-01T10:36:15.133Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9168aef41890a84ab07a402364384bd0","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.141Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-5ea5c6c1238df7716578c8f8: start","job_status":"start","queue_duration_s":1.317792,"scheduling_latency_s":1.317812}1261gitlab # [ 259.844292] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.512Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"5ea5c6c1238df7716578c8f8","created_at":"2026-09-01T10:36:15.133Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9168aef41890a84ab07a402364384bd0","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.141Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-5ea5c6c1238df7716578c8f8: done: 0.053225 sec","job_status":"done","queue_duration_s":1.317792,"scheduling_latency_s":1.317812,"redis_calls":10,"redis_duration_s":0.001975,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028626,"extra.ci_runners_stale_machines_cleanup_cron_worker.status":"success","extra.ci_runners_stale_machines_cleanup_cron_worker.total_deleted":0,"extra.ci_runners_stale_machines_cleanup_cron_worker.batch_counts":[0],"duration_s":0.053225,"completed_at":"2026-09-01T10:36:16.512Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 259.893249] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.514Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b03cb5c0ded330ef9e53b14e","created_at":"2026-09-01T10:36:15.153Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0db903177604bee957bb3ae9a7dfa23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.161Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b03cb5c0ded330ef9e53b14e: start","job_status":"start","queue_duration_s":1.352947,"scheduling_latency_s":1.352971}1263gitlab # [ 259.908836] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.529Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1264gitlab # [ 259.912428] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b03cb5c0ded330ef9e53b14e","created_at":"2026-09-01T10:36:15.153Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0db903177604bee957bb3ae9a7dfa23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.161Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b03cb5c0ded330ef9e53b14e: done: 0.025204 sec","job_status":"done","queue_duration_s":1.352947,"scheduling_latency_s":1.352971,"redis_calls":10,"redis_duration_s":0.002618,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000809,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035476,"duration_s":0.025204,"completed_at":"2026-09-01T10:36:16.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265gitlab # [ 259.954426] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bde4dbd183aa2abad9b0dfd8","created_at":"2026-09-01T10:36:15.166Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3a1705b428b48bf6ca668295575d30e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.174Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bde4dbd183aa2abad9b0dfd8: start","job_status":"start","queue_duration_s":1.366859,"scheduling_latency_s":1.366881}1266gitlab # [ 259.968341] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bde4dbd183aa2abad9b0dfd8","created_at":"2026-09-01T10:36:15.166Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3a1705b428b48bf6ca668295575d30e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.174Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bde4dbd183aa2abad9b0dfd8: done: 0.03863 sec","job_status":"done","queue_duration_s":1.366859,"scheduling_latency_s":1.366881,"redis_calls":12,"redis_duration_s":0.002613,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000464,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006825,"exclusive_lock_hold_duration_s":0.01244172,"duration_s":0.03863,"completed_at":"2026-09-01T10:36:16.579Z","load_balancing_strategy":"primary","db_duration_s":0.007484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 260.010362] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ab365be7f7cdd5956ed34ff6","created_at":"2026-09-01T10:36:15.180Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"afa4f43c7b9325fd3936e1f128b0d790","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.202Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ab365be7f7cdd5956ed34ff6: start","job_status":"start","queue_duration_s":1.379251,"scheduling_latency_s":1.379274}1268gitlab # [ 260.024939] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ab365be7f7cdd5956ed34ff6","created_at":"2026-09-01T10:36:15.180Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"afa4f43c7b9325fd3936e1f128b0d790","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.202Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ab365be7f7cdd5956ed34ff6: done: 0.027202 sec","job_status":"done","queue_duration_s":1.379251,"scheduling_latency_s":1.379274,"redis_calls":10,"redis_duration_s":0.002026,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000447,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002958,"duration_s":0.027202,"completed_at":"2026-09-01T10:36:16.609Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000949,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 260.069524] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"dccf66657b63d9f236914ae1","created_at":"2026-09-01T10:36:15.231Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8573c53ab88af4ac0f42bf73d2d736e0","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.253Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-dccf66657b63d9f236914ae1: start","job_status":"start","queue_duration_s":1.357603,"scheduling_latency_s":1.357626}1270gitlab # [ 260.144125] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.986Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"dccf66657b63d9f236914ae1","created_at":"2026-09-01T10:36:15.231Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8573c53ab88af4ac0f42bf73d2d736e0","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.253Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-dccf66657b63d9f236914ae1: done: 0.375372 sec","job_status":"done","queue_duration_s":1.357603,"scheduling_latency_s":1.357626,"redis_calls":565,"redis_duration_s":0.075692,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000447,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.073434,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.334895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00093348,"duration_s":0.375372,"completed_at":"2026-09-01T10:36:16.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 260.199603] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:16.988Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7a739df70d962900c73d8a59","created_at":"2026-09-01T10:36:15.232Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-830cbfe99ab64740","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.294Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7a739df70d962900c73d8a59: start","job_status":"start","queue_duration_s":1.693899,"scheduling_latency_s":1.693931}1272gitlab # [ 260.213273] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.020Z","message":"No existing merge request to be cleaned up."}1273gitlab # [ 260.215038] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.043Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7a739df70d962900c73d8a59","created_at":"2026-09-01T10:36:15.232Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-830cbfe99ab64740","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.294Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7a739df70d962900c73d8a59: done: 0.054793 sec","job_status":"done","queue_duration_s":1.693899,"scheduling_latency_s":1.693931,"redis_calls":13,"redis_duration_s":0.004131,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000535,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078666,"duration_s":0.054793,"completed_at":"2026-09-01T10:36:17.043Z","load_balancing_strategy":"primary","db_duration_s":0.009661,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 260.256542] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.045Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bc8f281097961edde5d51721","created_at":"2026-09-01T10:36:15.232Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-830cbfe99ab64740","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.294Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bc8f281097961edde5d51721: start","job_status":"start","queue_duration_s":1.750644,"scheduling_latency_s":1.750676}1275gitlab # [ 260.269066] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.063Z","message":"No existing merge request to be cleaned up."}1276gitlab # [ 260.270732] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.077Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bc8f281097961edde5d51721","created_at":"2026-09-01T10:36:15.232Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-830cbfe99ab64740","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.294Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bc8f281097961edde5d51721: done: 0.032306 sec","job_status":"done","queue_duration_s":1.750644,"scheduling_latency_s":1.750676,"redis_calls":10,"redis_duration_s":0.002953,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00151,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001443,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032306,"completed_at":"2026-09-01T10:36:17.077Z","load_balancing_strategy":"primary","db_duration_s":0.003001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 260.311169] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.080Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ce777161913bc9fe8b71cc6","created_at":"2026-09-01T10:36:15.232Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-830cbfe99ab64740","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.294Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ce777161913bc9fe8b71cc6: start","job_status":"start","queue_duration_s":1.785158,"scheduling_latency_s":1.78519}1278gitlab # [ 260.323716] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.097Z","message":"No existing merge request to be cleaned up."}1279gitlab # [ 260.325501] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.109Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ce777161913bc9fe8b71cc6","created_at":"2026-09-01T10:36:15.232Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-830cbfe99ab64740","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.294Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ce777161913bc9fe8b71cc6: done: 0.029836 sec","job_status":"done","queue_duration_s":1.785158,"scheduling_latency_s":1.78519,"redis_calls":10,"redis_duration_s":0.002382,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001478,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029836,"completed_at":"2026-09-01T10:36:17.109Z","load_balancing_strategy":"primary","db_duration_s":0.00327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 260.363898] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.111Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"27728d42153d00cdcfe226a6","created_at":"2026-09-01T10:36:15.232Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-830cbfe99ab64740","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.294Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-27728d42153d00cdcfe226a6: start","job_status":"start","queue_duration_s":1.816626,"scheduling_latency_s":1.816652}1281gitlab # [ 260.376391] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.124Z","message":"No existing merge request to be cleaned up."}1282gitlab # [ 260.378022] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.135Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"27728d42153d00cdcfe226a6","created_at":"2026-09-01T10:36:15.232Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-830cbfe99ab64740","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdda2165e37187113e2b657325a5b3e5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.294Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-27728d42153d00cdcfe226a6: done: 0.023952 sec","job_status":"done","queue_duration_s":1.816626,"scheduling_latency_s":1.816652,"redis_calls":10,"redis_duration_s":0.001576,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023952,"completed_at":"2026-09-01T10:36:17.135Z","load_balancing_strategy":"primary","db_duration_s":0.00196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 260.416115] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b6bd506b54989c81b74a891b","created_at":"2026-09-01T10:36:15.284Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a12ed7ac0058bc277a4d2e8628dc35b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.321Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b6bd506b54989c81b74a891b: start","job_status":"start","queue_duration_s":1.815249,"scheduling_latency_s":1.815276}1284gitlab # [ 260.430598] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b6bd506b54989c81b74a891b","created_at":"2026-09-01T10:36:15.284Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a12ed7ac0058bc277a4d2e8628dc35b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.321Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b6bd506b54989c81b74a891b: done: 0.043386 sec","job_status":"done","queue_duration_s":1.815249,"scheduling_latency_s":1.815276,"redis_calls":13,"redis_duration_s":0.0030470000000000002,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000429,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001229,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001389,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.013055559999999999,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.043386,"completed_at":"2026-09-01T10:36:17.180Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004941,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1285gitlab # [ 260.475041] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.182Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3acad3faef25089e08427268","created_at":"2026-09-01T10:36:15.337Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"c0fbd437ff189eb63da20aaf99834f0b","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.358Z","job_size_bytes":3,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3acad3faef25089e08427268: start","job_status":"start","queue_duration_s":1.823982,"scheduling_latency_s":1.824011}1286gitlab # [ 260.490552] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.211Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3acad3faef25089e08427268","created_at":"2026-09-01T10:36:15.337Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"c0fbd437ff189eb63da20aaf99834f0b","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.358Z","job_size_bytes":3,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3acad3faef25089e08427268: done: 0.028501 sec","job_status":"done","queue_duration_s":1.823982,"scheduling_latency_s":1.824011,"redis_calls":10,"redis_duration_s":0.0019660000000000003,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000447,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033066,"duration_s":0.028501,"completed_at":"2026-09-01T10:36:17.211Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 260.532885] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"81581a81c0316f8d0826e40e","created_at":"2026-09-01T10:36:15.379Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f96602e471174b2a7e3173d9d1e25e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.393Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-81581a81c0316f8d0826e40e: start","job_status":"start","queue_duration_s":1.820611,"scheduling_latency_s":1.82064}1288gitlab # [ 260.547390] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.290Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"81581a81c0316f8d0826e40e","created_at":"2026-09-01T10:36:15.379Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f96602e471174b2a7e3173d9d1e25e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.393Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-81581a81c0316f8d0826e40e: done: 0.076969 sec","job_status":"done","queue_duration_s":1.820611,"scheduling_latency_s":1.82064,"redis_calls":14,"redis_duration_s":0.003372,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000859,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00138,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00108792,"exclusive_lock_hold_duration_s":0.04273674,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.076969,"completed_at":"2026-09-01T10:36:17.290Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 260.593210] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"cf52b4b2a07486c0401e49fb","created_at":"2026-09-01T10:36:15.413Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8a3619bea7e3643cceafe52cf95de9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.429Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-cf52b4b2a07486c0401e49fb: start","job_status":"start","queue_duration_s":1.86392,"scheduling_latency_s":1.863947}1290gitlab # [ 260.608681] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.310Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1291gitlab # [ 260.612555] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"cf52b4b2a07486c0401e49fb","created_at":"2026-09-01T10:36:15.413Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8a3619bea7e3643cceafe52cf95de9c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.429Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-cf52b4b2a07486c0401e49fb: done: 0.028182 sec","job_status":"done","queue_duration_s":1.86392,"scheduling_latency_s":1.863947,"redis_calls":10,"redis_duration_s":0.002047,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000463,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034852,"duration_s":0.028182,"completed_at":"2026-09-01T10:36:17.321Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 260.657500] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.323Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1d62a6784eeb91c69ac49b54","created_at":"2026-09-01T10:36:15.438Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04d5d587318a1e7398c006fd82fa844e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.450Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1d62a6784eeb91c69ac49b54: start","job_status":"start","queue_duration_s":1.873158,"scheduling_latency_s":1.873188}1293gitlab # [ 260.672778] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.356Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1d62a6784eeb91c69ac49b54","created_at":"2026-09-01T10:36:15.438Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04d5d587318a1e7398c006fd82fa844e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.450Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1d62a6784eeb91c69ac49b54: done: 0.033824 sec","job_status":"done","queue_duration_s":1.873158,"scheduling_latency_s":1.873188,"redis_calls":12,"redis_duration_s":0.002728,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000462,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00071686,"exclusive_lock_hold_duration_s":0.00480838,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.033824,"completed_at":"2026-09-01T10:36:17.356Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002515,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 260.718856] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"20dc4b42cb79eda7e659d2c1","created_at":"2026-09-01T10:36:15.465Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.496Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-20dc4b42cb79eda7e659d2c1: start","job_status":"start","queue_duration_s":1.862718,"scheduling_latency_s":1.862744}1295gitlab # [ 260.733506] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"20dc4b42cb79eda7e659d2c1","created_at":"2026-09-01T10:36:15.465Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.496Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-20dc4b42cb79eda7e659d2c1: done: 0.163531 sec","job_status":"done","queue_duration_s":1.862718,"scheduling_latency_s":1.862744,"redis_calls":71,"redis_duration_s":0.020592,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002035,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001442,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.016321,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044974,"duration_s":0.163531,"completed_at":"2026-09-01T10:36:17.522Z","load_balancing_strategy":"primary","db_duration_s":0.003145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 260.777756] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f35f1c89c132a77ead69eaf8","created_at":"2026-09-01T10:36:15.525Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"249c3edfcc957299a3ae9e9684623059","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.554Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f35f1c89c132a77ead69eaf8: start","job_status":"start","queue_duration_s":1.970828,"scheduling_latency_s":1.970858}1297gitlab # [ 260.792506] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f35f1c89c132a77ead69eaf8","created_at":"2026-09-01T10:36:15.525Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"249c3edfcc957299a3ae9e9684623059","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:36:15.554Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f35f1c89c132a77ead69eaf8: done: 0.060429 sec","job_status":"done","queue_duration_s":1.970828,"scheduling_latency_s":1.970858,"redis_calls":10,"redis_duration_s":0.004467,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000641,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00076498,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.060429,"completed_at":"2026-09-01T10:36:17.585Z","load_balancing_strategy":"primary","db_duration_s":0.016282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 260.837880] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"25a071a670acc49213ea6764","created_at":"2026-09-01T10:36:16.435Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b86e867bfd43459e","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"50f41ffd5da94cee422378a4101af8a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:16.447Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-25a071a670acc49213ea6764: start","job_status":"start","queue_duration_s":1.139977,"scheduling_latency_s":1.140006}1299gitlab # [ 260.851840] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"25a071a670acc49213ea6764","created_at":"2026-09-01T10:36:16.435Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b86e867bfd43459e","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"50f41ffd5da94cee422378a4101af8a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:16.447Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-25a071a670acc49213ea6764: done: 0.070563 sec","job_status":"done","queue_duration_s":1.139977,"scheduling_latency_s":1.140006,"redis_calls":13,"redis_duration_s":0.005584,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00066,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00082176,"duration_s":0.070563,"completed_at":"2026-09-01T10:36:17.658Z","load_balancing_strategy":"primary","db_duration_s":0.008166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 260.894715] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd50c9ade3d5ffac58eeaca0","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd50c9ade3d5ffac58eeaca0: start","job_status":"start","queue_duration_s":0.152489,"scheduling_latency_s":0.152527}1301gitlab # [ 260.907249] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd50c9ade3d5ffac58eeaca0","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd50c9ade3d5ffac58eeaca0: done: 0.043491 sec","job_status":"done","queue_duration_s":0.152489,"scheduling_latency_s":0.152527,"redis_calls":16,"redis_duration_s":0.005594,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000748,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002993,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052846,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043491,"completed_at":"2026-09-01T10:36:17.704Z","load_balancing_strategy":"primary","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 260.948292] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b25f601535ba4711fe45e738","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b25f601535ba4711fe45e738: start","job_status":"start","queue_duration_s":0.198205,"scheduling_latency_s":0.198236}1303gitlab # [ 260.960577] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b25f601535ba4711fe45e738","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b25f601535ba4711fe45e738: done: 0.019924 sec","job_status":"done","queue_duration_s":0.198205,"scheduling_latency_s":0.198236,"redis_calls":13,"redis_duration_s":0.003078,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019924,"completed_at":"2026-09-01T10:36:17.727Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 260.999655] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5306f0bd6579cca46433a74a","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5306f0bd6579cca46433a74a: start","job_status":"start","queue_duration_s":0.219736,"scheduling_latency_s":0.21976}1305gitlab # [ 261.012202] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5306f0bd6579cca46433a74a","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5306f0bd6579cca46433a74a: done: 0.020152 sec","job_status":"done","queue_duration_s":0.219736,"scheduling_latency_s":0.21976,"redis_calls":13,"redis_duration_s":0.003872,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002778,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020152,"completed_at":"2026-09-01T10:36:17.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 261.051301] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed342a07082166f361ee2697","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed342a07082166f361ee2697: start","job_status":"start","queue_duration_s":0.241842,"scheduling_latency_s":0.241865}1307gitlab # [ 261.063571] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed342a07082166f361ee2697","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed342a07082166f361ee2697: done: 0.020135 sec","job_status":"done","queue_duration_s":0.241842,"scheduling_latency_s":0.241865,"redis_calls":13,"redis_duration_s":0.0036690000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00128,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002389,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020135,"completed_at":"2026-09-01T10:36:17.771Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 261.104292] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"822ac284beba735c0d1bd0bd","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-822ac284beba735c0d1bd0bd: start","job_status":"start","queue_duration_s":0.26404,"scheduling_latency_s":0.264063}1309gitlab # [ 261.116472] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"822ac284beba735c0d1bd0bd","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-822ac284beba735c0d1bd0bd: done: 0.019486 sec","job_status":"done","queue_duration_s":0.26404,"scheduling_latency_s":0.264063,"redis_calls":13,"redis_duration_s":0.0032189999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019486,"completed_at":"2026-09-01T10:36:17.792Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 261.155592] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cadb63596e8c0d06fbf8c8f0","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cadb63596e8c0d06fbf8c8f0: start","job_status":"start","queue_duration_s":0.285526,"scheduling_latency_s":0.285553}1311gitlab # [ 261.168115] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cadb63596e8c0d06fbf8c8f0","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cadb63596e8c0d06fbf8c8f0: done: 0.019915 sec","job_status":"done","queue_duration_s":0.285526,"scheduling_latency_s":0.285553,"redis_calls":13,"redis_duration_s":0.003076,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019915,"completed_at":"2026-09-01T10:36:17.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 261.206966] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1dc23aa1dc7d632603cf8a2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1dc23aa1dc7d632603cf8a2: start","job_status":"start","queue_duration_s":0.307488,"scheduling_latency_s":0.307514}1313gitlab # [ 261.219465] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1dc23aa1dc7d632603cf8a2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1dc23aa1dc7d632603cf8a2: done: 0.019721 sec","job_status":"done","queue_duration_s":0.307488,"scheduling_latency_s":0.307514,"redis_calls":13,"redis_duration_s":0.003183,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019721,"completed_at":"2026-09-01T10:36:17.836Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 261.258891] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56d25611581534ab55321f72","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56d25611581534ab55321f72: start","job_status":"start","queue_duration_s":0.32921,"scheduling_latency_s":0.329234}1315gitlab # [ 261.271410] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56d25611581534ab55321f72","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56d25611581534ab55321f72: done: 0.019946 sec","job_status":"done","queue_duration_s":0.32921,"scheduling_latency_s":0.329234,"redis_calls":13,"redis_duration_s":0.002935,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019946,"completed_at":"2026-09-01T10:36:17.858Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 261.311909] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66a1ff28e68663f251477a4f","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66a1ff28e68663f251477a4f: start","job_status":"start","queue_duration_s":0.350878,"scheduling_latency_s":0.350901}1317gitlab # [ 261.324463] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66a1ff28e68663f251477a4f","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66a1ff28e68663f251477a4f: done: 0.020308 sec","job_status":"done","queue_duration_s":0.350878,"scheduling_latency_s":0.350901,"redis_calls":13,"redis_duration_s":0.0033309999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020308,"completed_at":"2026-09-01T10:36:17.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 261.363621] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83ea101159fc3c336c91bed6","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83ea101159fc3c336c91bed6: start","job_status":"start","queue_duration_s":0.372937,"scheduling_latency_s":0.37296}1319gitlab # [ 261.376421] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83ea101159fc3c336c91bed6","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83ea101159fc3c336c91bed6: done: 0.01966 sec","job_status":"done","queue_duration_s":0.372937,"scheduling_latency_s":0.37296,"redis_calls":13,"redis_duration_s":0.003009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001075,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01966,"completed_at":"2026-09-01T10:36:17.901Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 261.417019] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51145a6634115ff8fcd8cf1c","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51145a6634115ff8fcd8cf1c: start","job_status":"start","queue_duration_s":0.394368,"scheduling_latency_s":0.394391}1321gitlab # [ 261.430144] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51145a6634115ff8fcd8cf1c","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51145a6634115ff8fcd8cf1c: done: 0.019767 sec","job_status":"done","queue_duration_s":0.394368,"scheduling_latency_s":0.394391,"redis_calls":13,"redis_duration_s":0.003188,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019767,"completed_at":"2026-09-01T10:36:17.923Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 261.470684] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1abddea296f753cd7f9579b","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1abddea296f753cd7f9579b: start","job_status":"start","queue_duration_s":0.415838,"scheduling_latency_s":0.415862}1323gitlab # [ 261.483947] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1abddea296f753cd7f9579b","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1abddea296f753cd7f9579b: done: 0.019638 sec","job_status":"done","queue_duration_s":0.415838,"scheduling_latency_s":0.415862,"redis_calls":13,"redis_duration_s":0.0031739999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019638,"completed_at":"2026-09-01T10:36:17.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 261.527126] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"297911c34b40cd4c3a9d39c9","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-297911c34b40cd4c3a9d39c9: start","job_status":"start","queue_duration_s":0.437538,"scheduling_latency_s":0.437559}1325gitlab # [ 261.540447] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"297911c34b40cd4c3a9d39c9","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-297911c34b40cd4c3a9d39c9: done: 0.019829 sec","job_status":"done","queue_duration_s":0.437538,"scheduling_latency_s":0.437559,"redis_calls":13,"redis_duration_s":0.0033420000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019829,"completed_at":"2026-09-01T10:36:17.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 261.581354] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"533dd7ee92c72bac6c15a32e","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-533dd7ee92c72bac6c15a32e: start","job_status":"start","queue_duration_s":0.459459,"scheduling_latency_s":0.459481}1327gitlab # [ 261.594958] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"533dd7ee92c72bac6c15a32e","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-533dd7ee92c72bac6c15a32e: done: 0.01955 sec","job_status":"done","queue_duration_s":0.459459,"scheduling_latency_s":0.459481,"redis_calls":13,"redis_duration_s":0.003271,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01955,"completed_at":"2026-09-01T10:36:17.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 261.635888] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:17.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9527f2e0554b810583357812","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9527f2e0554b810583357812: start","job_status":"start","queue_duration_s":0.481042,"scheduling_latency_s":0.481065}1329gitlab # [ 261.649204] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9527f2e0554b810583357812","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9527f2e0554b810583357812: done: 0.018101 sec","job_status":"done","queue_duration_s":0.481042,"scheduling_latency_s":0.481065,"redis_calls":13,"redis_duration_s":0.002686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001704,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018101,"completed_at":"2026-09-01T10:36:18.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 261.690400] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3d78cae1020fcb8393024c3","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3d78cae1020fcb8393024c3: start","job_status":"start","queue_duration_s":0.500891,"scheduling_latency_s":0.500913}1331gitlab # [ 261.703620] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3d78cae1020fcb8393024c3","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3d78cae1020fcb8393024c3: done: 0.018621 sec","job_status":"done","queue_duration_s":0.500891,"scheduling_latency_s":0.500913,"redis_calls":13,"redis_duration_s":0.0026709999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001644,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018621,"completed_at":"2026-09-01T10:36:18.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 261.744772] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c4920e60e91a90e0b13d2ff","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c4920e60e91a90e0b13d2ff: start","job_status":"start","queue_duration_s":0.521428,"scheduling_latency_s":0.521448}1333gitlab # [ 261.757882] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c4920e60e91a90e0b13d2ff","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c4920e60e91a90e0b13d2ff: done: 0.019988 sec","job_status":"done","queue_duration_s":0.521428,"scheduling_latency_s":0.521448,"redis_calls":13,"redis_duration_s":0.002444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001421,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019988,"completed_at":"2026-09-01T10:36:18.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 261.798609] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25adc44c10f414ba053d6173","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25adc44c10f414ba053d6173: start","job_status":"start","queue_duration_s":0.543649,"scheduling_latency_s":0.543676}1335gitlab # [ 261.811142] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25adc44c10f414ba053d6173","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25adc44c10f414ba053d6173: done: 0.02061 sec","job_status":"done","queue_duration_s":0.543649,"scheduling_latency_s":0.543676,"redis_calls":13,"redis_duration_s":0.002674,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02061,"completed_at":"2026-09-01T10:36:18.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 261.850616] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72bdac08d0b0429f2ce497c3","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72bdac08d0b0429f2ce497c3: start","job_status":"start","queue_duration_s":0.566047,"scheduling_latency_s":0.566074}1337gitlab # [ 261.863066] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72bdac08d0b0429f2ce497c3","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72bdac08d0b0429f2ce497c3: done: 0.020244 sec","job_status":"done","queue_duration_s":0.566047,"scheduling_latency_s":0.566074,"redis_calls":13,"redis_duration_s":0.0022689999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020244,"completed_at":"2026-09-01T10:36:18.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 261.902184] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a743c3d8724bb9682faba3ba","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a743c3d8724bb9682faba3ba: start","job_status":"start","queue_duration_s":0.587763,"scheduling_latency_s":0.587784}1339gitlab # [ 261.915846] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a743c3d8724bb9682faba3ba","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a743c3d8724bb9682faba3ba: done: 0.019497 sec","job_status":"done","queue_duration_s":0.587763,"scheduling_latency_s":0.587784,"redis_calls":13,"redis_duration_s":0.002347,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001548,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019497,"completed_at":"2026-09-01T10:36:18.116Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 261.955235] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94ea1b0422c38006eff80ac5","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94ea1b0422c38006eff80ac5: start","job_status":"start","queue_duration_s":0.608779,"scheduling_latency_s":0.608801}1341gitlab # [ 261.967591] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94ea1b0422c38006eff80ac5","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94ea1b0422c38006eff80ac5: done: 0.01949 sec","job_status":"done","queue_duration_s":0.608779,"scheduling_latency_s":0.608801,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01949,"completed_at":"2026-09-01T10:36:18.137Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 262.006745] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05f4024bce48b0ebb22c42a2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05f4024bce48b0ebb22c42a2: start","job_status":"start","queue_duration_s":0.629776,"scheduling_latency_s":0.629799}1343gitlab # [ 262.019352] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05f4024bce48b0ebb22c42a2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05f4024bce48b0ebb22c42a2: done: 0.020734 sec","job_status":"done","queue_duration_s":0.629776,"scheduling_latency_s":0.629799,"redis_calls":13,"redis_duration_s":0.002341,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001472,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020734,"completed_at":"2026-09-01T10:36:18.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 262.059434] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a2d7a49d12c5f336b1002d2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a2d7a49d12c5f336b1002d2: start","job_status":"start","queue_duration_s":0.652258,"scheduling_latency_s":0.652281}1345gitlab # [ 262.072370] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a2d7a49d12c5f336b1002d2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a2d7a49d12c5f336b1002d2: done: 0.019267 sec","job_status":"done","queue_duration_s":0.652258,"scheduling_latency_s":0.652281,"redis_calls":13,"redis_duration_s":0.002307,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001495,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019267,"completed_at":"2026-09-01T10:36:18.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 262.111415] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f61b8afd4725389f917441d8","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f61b8afd4725389f917441d8: start","job_status":"start","queue_duration_s":0.673219,"scheduling_latency_s":0.673239}1347gitlab # [ 262.126081] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f61b8afd4725389f917441d8","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f61b8afd4725389f917441d8: done: 0.017177 sec","job_status":"done","queue_duration_s":0.673219,"scheduling_latency_s":0.673239,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017177,"completed_at":"2026-09-01T10:36:18.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 262.167593] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cfd2e506304e0b52909b1fa","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cfd2e506304e0b52909b1fa: start","job_status":"start","queue_duration_s":0.691929,"scheduling_latency_s":0.691951}1349gitlab # [ 262.180965] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cfd2e506304e0b52909b1fa","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cfd2e506304e0b52909b1fa: done: 0.01745 sec","job_status":"done","queue_duration_s":0.691929,"scheduling_latency_s":0.691951,"redis_calls":13,"redis_duration_s":0.0016970000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01745,"completed_at":"2026-09-01T10:36:18.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 262.220831] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78cb28855c99a03cd4544b64","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78cb28855c99a03cd4544b64: start","job_status":"start","queue_duration_s":0.711195,"scheduling_latency_s":0.711218}1351gitlab # [ 262.233193] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78cb28855c99a03cd4544b64","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78cb28855c99a03cd4544b64: done: 0.018021 sec","job_status":"done","queue_duration_s":0.711195,"scheduling_latency_s":0.711218,"redis_calls":13,"redis_duration_s":0.001765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018021,"completed_at":"2026-09-01T10:36:18.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 262.272604] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d60ee12e58cc0634cf4ee53","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d60ee12e58cc0634cf4ee53: start","job_status":"start","queue_duration_s":0.730919,"scheduling_latency_s":0.730941}1353gitlab # [ 262.284958] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d60ee12e58cc0634cf4ee53","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d60ee12e58cc0634cf4ee53: done: 0.018769 sec","job_status":"done","queue_duration_s":0.730919,"scheduling_latency_s":0.730941,"redis_calls":13,"redis_duration_s":0.001905,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018769,"completed_at":"2026-09-01T10:36:18.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 262.325740] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95b32f2e5cdc83eba0f9312c","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95b32f2e5cdc83eba0f9312c: start","job_status":"start","queue_duration_s":0.751464,"scheduling_latency_s":0.751487}1355gitlab # [ 262.338478] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95b32f2e5cdc83eba0f9312c","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95b32f2e5cdc83eba0f9312c: done: 0.018663 sec","job_status":"done","queue_duration_s":0.751464,"scheduling_latency_s":0.751487,"redis_calls":13,"redis_duration_s":0.001886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018663,"completed_at":"2026-09-01T10:36:18.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 262.377547] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91bf9bc19a0a260509b50379","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91bf9bc19a0a260509b50379: start","job_status":"start","queue_duration_s":0.771691,"scheduling_latency_s":0.771715}1357gitlab # [ 262.389940] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91bf9bc19a0a260509b50379","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91bf9bc19a0a260509b50379: done: 0.018865 sec","job_status":"done","queue_duration_s":0.771691,"scheduling_latency_s":0.771715,"redis_calls":13,"redis_duration_s":0.001951,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018865,"completed_at":"2026-09-01T10:36:18.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 262.428583] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9f630c4daa55cd692c21da9","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9f630c4daa55cd692c21da9: start","job_status":"start","queue_duration_s":0.792257,"scheduling_latency_s":0.792282}1359gitlab # [ 262.440790] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9f630c4daa55cd692c21da9","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9f630c4daa55cd692c21da9: done: 0.019665 sec","job_status":"done","queue_duration_s":0.792257,"scheduling_latency_s":0.792282,"redis_calls":13,"redis_duration_s":0.001963,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019665,"completed_at":"2026-09-01T10:36:18.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 262.479760] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"536995535c09fab42fae43bc","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-536995535c09fab42fae43bc: start","job_status":"start","queue_duration_s":0.813439,"scheduling_latency_s":0.813464}1361gitlab # [ 262.492245] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"536995535c09fab42fae43bc","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-536995535c09fab42fae43bc: done: 0.019617 sec","job_status":"done","queue_duration_s":0.813439,"scheduling_latency_s":0.813464,"redis_calls":13,"redis_duration_s":0.001956,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019617,"completed_at":"2026-09-01T10:36:18.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 262.532185] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b944bf595f3b7f7413563c30","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b944bf595f3b7f7413563c30: start","job_status":"start","queue_duration_s":0.834563,"scheduling_latency_s":0.834586}1363gitlab # [ 262.544455] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b944bf595f3b7f7413563c30","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b944bf595f3b7f7413563c30: done: 0.0202 sec","job_status":"done","queue_duration_s":0.834563,"scheduling_latency_s":0.834586,"redis_calls":13,"redis_duration_s":0.002006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001293,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0202,"completed_at":"2026-09-01T10:36:18.363Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 262.583115] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4941a2aec6b060d13be0449b","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4941a2aec6b060d13be0449b: start","job_status":"start","queue_duration_s":0.856437,"scheduling_latency_s":0.856463}1365gitlab # [ 262.596121] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4941a2aec6b060d13be0449b","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4941a2aec6b060d13be0449b: done: 0.019533 sec","job_status":"done","queue_duration_s":0.856437,"scheduling_latency_s":0.856463,"redis_calls":13,"redis_duration_s":0.001979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001247,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019533,"completed_at":"2026-09-01T10:36:18.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 262.635165] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"417944092dce8bce403bf919","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-417944092dce8bce403bf919: start","job_status":"start","queue_duration_s":0.877487,"scheduling_latency_s":0.877511}1367gitlab # [ 262.647662] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"417944092dce8bce403bf919","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-417944092dce8bce403bf919: done: 0.019296 sec","job_status":"done","queue_duration_s":0.877487,"scheduling_latency_s":0.877511,"redis_calls":13,"redis_duration_s":0.00198,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019296,"completed_at":"2026-09-01T10:36:18.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 262.687110] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ef8915744699761ded65490","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ef8915744699761ded65490: start","job_status":"start","queue_duration_s":0.898628,"scheduling_latency_s":0.898655}1369gitlab # [ 262.699673] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ef8915744699761ded65490","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ef8915744699761ded65490: done: 0.019226 sec","job_status":"done","queue_duration_s":0.898628,"scheduling_latency_s":0.898655,"redis_calls":13,"redis_duration_s":0.001993,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001269,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019226,"completed_at":"2026-09-01T10:36:18.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 262.740871] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f53260f7df722f6392ce1839","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f53260f7df722f6392ce1839: start","job_status":"start","queue_duration_s":0.920011,"scheduling_latency_s":0.920038}1371gitlab # [ 262.754490] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f53260f7df722f6392ce1839","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f53260f7df722f6392ce1839: done: 0.019692 sec","job_status":"done","queue_duration_s":0.920011,"scheduling_latency_s":0.920038,"redis_calls":13,"redis_duration_s":0.002267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019692,"completed_at":"2026-09-01T10:36:18.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 262.795418] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"609974b656c5344e3da9adc8","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-609974b656c5344e3da9adc8: start","job_status":"start","queue_duration_s":0.941453,"scheduling_latency_s":0.941478}1373gitlab # [ 262.808045] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"609974b656c5344e3da9adc8","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-609974b656c5344e3da9adc8: done: 0.018151 sec","job_status":"done","queue_duration_s":0.941453,"scheduling_latency_s":0.941478,"redis_calls":13,"redis_duration_s":0.002125,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001504,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018151,"completed_at":"2026-09-01T10:36:18.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 262.847405] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9fca80fb5c32e90e76546b2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9fca80fb5c32e90e76546b2: start","job_status":"start","queue_duration_s":0.961214,"scheduling_latency_s":0.961238}1375gitlab # [ 262.860043] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9fca80fb5c32e90e76546b2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9fca80fb5c32e90e76546b2: done: 0.018131 sec","job_status":"done","queue_duration_s":0.961214,"scheduling_latency_s":0.961238,"redis_calls":13,"redis_duration_s":0.0018059999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018131,"completed_at":"2026-09-01T10:36:18.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 262.899159] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da17ac62f72f29fbe42850cb","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da17ac62f72f29fbe42850cb: start","job_status":"start","queue_duration_s":0.981118,"scheduling_latency_s":0.981142}1377gitlab # [ 262.911689] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da17ac62f72f29fbe42850cb","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da17ac62f72f29fbe42850cb: done: 0.018731 sec","job_status":"done","queue_duration_s":0.981118,"scheduling_latency_s":0.981142,"redis_calls":13,"redis_duration_s":0.0018319999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018731,"completed_at":"2026-09-01T10:36:18.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 262.953074] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da4e13718dd9c220b2ebcda3","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da4e13718dd9c220b2ebcda3: start","job_status":"start","queue_duration_s":1.001455,"scheduling_latency_s":1.001478}1379gitlab # [ 262.965525] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da4e13718dd9c220b2ebcda3","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da4e13718dd9c220b2ebcda3: done: 0.019185 sec","job_status":"done","queue_duration_s":1.001455,"scheduling_latency_s":1.001478,"redis_calls":13,"redis_duration_s":0.00195,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001264,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019185,"completed_at":"2026-09-01T10:36:18.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 263.004466] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6e3adcfab6119ef1c7ddd66","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6e3adcfab6119ef1c7ddd66: start","job_status":"start","queue_duration_s":1.022171,"scheduling_latency_s":1.022196}1381gitlab # [ 263.017493] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6e3adcfab6119ef1c7ddd66","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6e3adcfab6119ef1c7ddd66: done: 0.019981 sec","job_status":"done","queue_duration_s":1.022171,"scheduling_latency_s":1.022196,"redis_calls":13,"redis_duration_s":0.002281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019981,"completed_at":"2026-09-01T10:36:18.551Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 263.057157] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2e9b0910838437d6eef5270","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2e9b0910838437d6eef5270: start","job_status":"start","queue_duration_s":1.043728,"scheduling_latency_s":1.043751}1383gitlab # [ 263.069559] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2e9b0910838437d6eef5270","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2e9b0910838437d6eef5270: done: 0.019437 sec","job_status":"done","queue_duration_s":1.043728,"scheduling_latency_s":1.043751,"redis_calls":13,"redis_duration_s":0.001988,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001261,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019437,"completed_at":"2026-09-01T10:36:18.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 263.108495] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438cb3ebf45eb208c44eacc2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438cb3ebf45eb208c44eacc2: start","job_status":"start","queue_duration_s":1.064663,"scheduling_latency_s":1.064686}1385gitlab # [ 263.120756] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438cb3ebf45eb208c44eacc2","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438cb3ebf45eb208c44eacc2: done: 0.019267 sec","job_status":"done","queue_duration_s":1.064663,"scheduling_latency_s":1.064686,"redis_calls":13,"redis_duration_s":0.002232,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001493,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019267,"completed_at":"2026-09-01T10:36:18.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 263.161801] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45788e5a3cb62baad503e647","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45788e5a3cb62baad503e647: start","job_status":"start","queue_duration_s":1.085419,"scheduling_latency_s":1.085443}1387gitlab # [ 263.178344] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45788e5a3cb62baad503e647","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45788e5a3cb62baad503e647: done: 0.018912 sec","job_status":"done","queue_duration_s":1.085419,"scheduling_latency_s":1.085443,"redis_calls":13,"redis_duration_s":0.0020039999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018912,"completed_at":"2026-09-01T10:36:18.613Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 263.222348] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eeaeee52b1e5eb0c38d47461","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eeaeee52b1e5eb0c38d47461: start","job_status":"start","queue_duration_s":1.106176,"scheduling_latency_s":1.106201}1389gitlab # [ 263.236254] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eeaeee52b1e5eb0c38d47461","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eeaeee52b1e5eb0c38d47461: done: 0.019211 sec","job_status":"done","queue_duration_s":1.106176,"scheduling_latency_s":1.106201,"redis_calls":13,"redis_duration_s":0.001928,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001227,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019211,"completed_at":"2026-09-01T10:36:18.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 263.277875] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aabff7f09fc326a9e06963e","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aabff7f09fc326a9e06963e: start","job_status":"start","queue_duration_s":1.12711,"scheduling_latency_s":1.127134}1391gitlab # [ 263.291207] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aabff7f09fc326a9e06963e","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aabff7f09fc326a9e06963e: done: 0.020228 sec","job_status":"done","queue_duration_s":1.12711,"scheduling_latency_s":1.127134,"redis_calls":13,"redis_duration_s":0.002411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001656,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020228,"completed_at":"2026-09-01T10:36:18.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 263.333264] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f9a5409aec979dd8b18b7e7","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f9a5409aec979dd8b18b7e7: start","job_status":"start","queue_duration_s":1.149081,"scheduling_latency_s":1.149107}1393gitlab # [ 263.347040] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f9a5409aec979dd8b18b7e7","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f9a5409aec979dd8b18b7e7: done: 0.017616 sec","job_status":"done","queue_duration_s":1.149081,"scheduling_latency_s":1.149107,"redis_calls":13,"redis_duration_s":0.0015930000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017616,"completed_at":"2026-09-01T10:36:18.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 263.386580] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28885a4ea9da7d9eb20022db","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28885a4ea9da7d9eb20022db: start","job_status":"start","queue_duration_s":1.16835,"scheduling_latency_s":1.168374}1395gitlab # [ 263.399159] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28885a4ea9da7d9eb20022db","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28885a4ea9da7d9eb20022db: done: 0.0181 sec","job_status":"done","queue_duration_s":1.16835,"scheduling_latency_s":1.168374,"redis_calls":13,"redis_duration_s":0.0018440000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0181,"completed_at":"2026-09-01T10:36:18.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 263.438219] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e370329fd71899b437ca8a6","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e370329fd71899b437ca8a6: start","job_status":"start","queue_duration_s":1.188388,"scheduling_latency_s":1.188412}1397gitlab # [ 263.450695] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e370329fd71899b437ca8a6","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e370329fd71899b437ca8a6: done: 0.018524 sec","job_status":"done","queue_duration_s":1.188388,"scheduling_latency_s":1.188412,"redis_calls":13,"redis_duration_s":0.001886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018524,"completed_at":"2026-09-01T10:36:18.715Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 263.489864] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e24c90115feeac84023e942","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e24c90115feeac84023e942: start","job_status":"start","queue_duration_s":1.20838,"scheduling_latency_s":1.208405}1399gitlab # [ 263.502303] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:36:18.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e24c90115feeac84023e942","created_at":"2026-09-01T10:36:17.389Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-b2e9e4a4fd714cf9","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"46458b777e1db1f59c857ba821487822","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:36:17.509Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e24c90115feeac84023e942: done: 0.019048 sec","job_status":"done","queue_duration_s":1.20838,"scheduling_latency_s":1.208405,"redis_calls":13,"redis_duration_s":0.002214,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001501,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019048,"completed_at":"2026-09-01T10:36:18.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 294.707496] setup-gitlab-start[3135]: W, [2026-09-01T10:36:51.550571 #3135] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1401gitlab # [ 305.422501] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"003cc1e8570040d375423fcc","created_at":"2026-09-01T10:37:02.240Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6882b7b5e006a5b74a6dbe79760acde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.261Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-003cc1e8570040d375423fcc: start","job_status":"start","queue_duration_s":0.002444,"scheduling_latency_s":0.002501}1402gitlab # [ 305.511782] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.355Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1403gitlab # [ 305.617887] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.461Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"003cc1e8570040d375423fcc","created_at":"2026-09-01T10:37:02.240Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6882b7b5e006a5b74a6dbe79760acde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.261Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-003cc1e8570040d375423fcc: done: 0.197299 sec","job_status":"done","queue_duration_s":0.002444,"scheduling_latency_s":0.002501,"redis_calls":16,"redis_duration_s":0.071036,"redis_read_bytes":1033,"redis_write_bytes":1298,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.016239,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":523,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.046099,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":531,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.008698,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.197299,"completed_at":"2026-09-01T10:37:02.461Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 305.703505] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"7481eea75e3859ecf43ccdb8","created_at":"2026-09-01T10:37:02.291Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0a459cec20d2b2907b1fb5ae337364b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:37:02.297Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-7481eea75e3859ecf43ccdb8: start","job_status":"start","queue_duration_s":0.242376,"scheduling_latency_s":0.242433}1405gitlab # [ 305.784570] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.628Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1406gitlab # [ 305.887189] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.730Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"7481eea75e3859ecf43ccdb8","created_at":"2026-09-01T10:37:02.291Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0a459cec20d2b2907b1fb5ae337364b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:37:02.297Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-7481eea75e3859ecf43ccdb8: done: 0.190937 sec","job_status":"done","queue_duration_s":0.242376,"scheduling_latency_s":0.242433,"redis_calls":7,"redis_duration_s":0.01057,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004961,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.190937,"completed_at":"2026-09-01T10:37:02.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 305.972438] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.773Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6f2b41e91e0d9b82dc5d50a7","created_at":"2026-09-01T10:37:02.303Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f56a64433838210b452c2652f6d9b73f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:37:02.309Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6f2b41e91e0d9b82dc5d50a7: start","job_status":"start","queue_duration_s":0.463578,"scheduling_latency_s":0.463639}1408gitlab # [ 306.054611] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.897Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6f2b41e91e0d9b82dc5d50a7","created_at":"2026-09-01T10:37:02.303Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f56a64433838210b452c2652f6d9b73f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:37:02.309Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6f2b41e91e0d9b82dc5d50a7: done: 0.124502 sec","job_status":"done","queue_duration_s":0.463578,"scheduling_latency_s":0.463639,"redis_calls":8,"redis_duration_s":0.025222,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001633,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.021121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002468,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.124502,"completed_at":"2026-09-01T10:37:02.897Z","load_balancing_strategy":"primary","db_duration_s":0.007793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 306.141648] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.911Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"20bd1124a2154033b3393aee","created_at":"2026-09-01T10:37:02.328Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"143d69163ea3377f11878cb13759cab6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.340Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-20bd1124a2154033b3393aee: start","job_status":"start","queue_duration_s":0.57113,"scheduling_latency_s":0.571187}1410gitlab # [ 306.159470] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:02.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"20bd1124a2154033b3393aee","created_at":"2026-09-01T10:37:02.328Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"143d69163ea3377f11878cb13759cab6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.340Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-20bd1124a2154033b3393aee: done: 0.086745 sec","job_status":"done","queue_duration_s":0.57113,"scheduling_latency_s":0.571187,"redis_calls":7,"redis_duration_s":0.035123,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01024,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.024883,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.086745,"completed_at":"2026-09-01T10:37:02.998Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 306.201269] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f20c992fb567b3225ce670d1","created_at":"2026-09-01T10:37:02.375Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.386Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f20c992fb567b3225ce670d1: start","job_status":"start","queue_duration_s":0.618452,"scheduling_latency_s":0.618509}1412gitlab # [ 306.335191] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f20c992fb567b3225ce670d1","created_at":"2026-09-01T10:37:02.375Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.386Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f20c992fb567b3225ce670d1: done: 0.173261 sec","job_status":"done","queue_duration_s":0.618452,"scheduling_latency_s":0.618509,"redis_calls":15,"redis_duration_s":0.051225,"redis_read_bytes":144,"redis_write_bytes":4079,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.003053,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_calls":2,"redis_queues_duration_s":0.001222,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.043031,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003919,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.173261,"completed_at":"2026-09-01T10:37:03.178Z","load_balancing_strategy":"primary","db_duration_s":0.00389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 306.410511] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d570a4e9732687013e737ab6","created_at":"2026-09-01T10:37:02.442Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e51e83fcffb5621d684d904572ef4a5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.455Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d570a4e9732687013e737ab6: start","job_status":"start","queue_duration_s":0.731629,"scheduling_latency_s":0.731689}1414gitlab # [ 306.428650] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.230Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"d570a4e9732687013e737ab6","created_at":"2026-09-01T10:37:02.442Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e51e83fcffb5621d684d904572ef4a5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.455Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-d570a4e9732687013e737ab6: done: 0.043858 sec","job_status":"done","queue_duration_s":0.731629,"scheduling_latency_s":0.731689,"redis_calls":7,"redis_duration_s":0.002922,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043858,"completed_at":"2026-09-01T10:37:03.230Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 306.478413] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e4008f3223b62253f6431d96","created_at":"2026-09-01T10:37:02.537Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36eaa1c307120d03009420e0bca3592c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.550Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e4008f3223b62253f6431d96: start","job_status":"start","queue_duration_s":0.683118,"scheduling_latency_s":0.683162}1416gitlab # [ 306.793996] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e4008f3223b62253f6431d96","created_at":"2026-09-01T10:37:02.537Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36eaa1c307120d03009420e0bca3592c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.550Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e4008f3223b62253f6431d96: done: 0.40427 sec","job_status":"done","queue_duration_s":0.683118,"scheduling_latency_s":0.683162,"redis_calls":9,"redis_duration_s":0.003111,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001617,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001494,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.085,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.085,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.278101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00108558,"exclusive_lock_hold_duration_s":0.37522808,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.40427,"completed_at":"2026-09-01T10:37:03.637Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.147883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 306.897562] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"bcad3ba046095d0f03b3e3d3","created_at":"2026-09-01T10:37:02.577Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27778186cc715c8274a68b2d8c7970da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.584Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-bcad3ba046095d0f03b3e3d3: start","job_status":"start","queue_duration_s":1.055093,"scheduling_latency_s":1.055115}1418gitlab # [ 306.921149] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.648Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1419gitlab # [ 306.926354] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"bcad3ba046095d0f03b3e3d3","created_at":"2026-09-01T10:37:02.577Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27778186cc715c8274a68b2d8c7970da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.584Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-bcad3ba046095d0f03b3e3d3: done: 0.01511 sec","job_status":"done","queue_duration_s":1.055093,"scheduling_latency_s":1.055115,"redis_calls":7,"redis_duration_s":0.001693,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01511,"completed_at":"2026-09-01T10:37:03.654Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 306.972623] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"95f1802e94c667e32d29b34a","created_at":"2026-09-01T10:37:02.597Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5cf09dee174247ed6e986ad061b6955f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.605Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-95f1802e94c667e32d29b34a: start","job_status":"start","queue_duration_s":1.051604,"scheduling_latency_s":1.051621}1421gitlab # [ 307.087160] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"95f1802e94c667e32d29b34a","created_at":"2026-09-01T10:37:02.597Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5cf09dee174247ed6e986ad061b6955f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.605Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-95f1802e94c667e32d29b34a: done: 0.273591 sec","job_status":"done","queue_duration_s":1.051604,"scheduling_latency_s":1.051621,"redis_calls":9,"redis_duration_s":0.008389,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.2,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.2,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00254246,"exclusive_lock_hold_duration_s":0.049067,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.273591,"completed_at":"2026-09-01T10:37:03.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.204499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 307.177894] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:03.935Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e830b5908e028d5b67366a67","created_at":"2026-09-01T10:37:02.637Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93bd285842fb1a73e4c5ea89034c9cbc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.653Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e830b5908e028d5b67366a67: start","job_status":"start","queue_duration_s":1.28149,"scheduling_latency_s":1.28154}1423gitlab # [ 307.241816] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.085Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e830b5908e028d5b67366a67","created_at":"2026-09-01T10:37:02.637Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93bd285842fb1a73e4c5ea89034c9cbc","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.653Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e830b5908e028d5b67366a67: done: 0.150131 sec","job_status":"done","queue_duration_s":1.28149,"scheduling_latency_s":1.28154,"redis_calls":7,"redis_duration_s":0.006583,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004528,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.087,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.150131,"completed_at":"2026-09-01T10:37:04.084Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08814,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 307.328264] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"82104cfdd8a214e6ee84bc8b","created_at":"2026-09-01T10:37:02.722Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1104fb294cf0ec4575e64b808bb214d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:37:02.727Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-82104cfdd8a214e6ee84bc8b: start","job_status":"start","queue_duration_s":1.444787,"scheduling_latency_s":1.444841}1425gitlab # [ 307.397734] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.241Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1426gitlab # [ 307.421122] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"82104cfdd8a214e6ee84bc8b","created_at":"2026-09-01T10:37:02.722Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1104fb294cf0ec4575e64b808bb214d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:37:02.727Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-82104cfdd8a214e6ee84bc8b: done: 0.09229 sec","job_status":"done","queue_duration_s":1.444787,"scheduling_latency_s":1.444841,"redis_calls":7,"redis_duration_s":0.006578,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.09229,"completed_at":"2026-09-01T10:37:04.264Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 307.497982] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.273Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2d34b00ff1f423307c0ecbdc","created_at":"2026-09-01T10:37:02.775Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3594d851fb9a8709fbab4c89343c52eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.781Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2d34b00ff1f423307c0ecbdc: start","job_status":"start","queue_duration_s":1.491955,"scheduling_latency_s":1.492003}1428gitlab # [ 307.516575] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.305Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1429gitlab # [ 307.520430] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2d34b00ff1f423307c0ecbdc","created_at":"2026-09-01T10:37:02.775Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3594d851fb9a8709fbab4c89343c52eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.781Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2d34b00ff1f423307c0ecbdc: done: 0.064079 sec","job_status":"done","queue_duration_s":1.491955,"scheduling_latency_s":1.492003,"redis_calls":7,"redis_duration_s":0.013373999999999999,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002629,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064079,"completed_at":"2026-09-01T10:37:04.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 307.566820] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.349Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f292be379ebb68f70218e1b7","created_at":"2026-09-01T10:37:02.790Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8a1334250b7483935b5f4ba1738200a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.794Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f292be379ebb68f70218e1b7: start","job_status":"start","queue_duration_s":1.554861,"scheduling_latency_s":1.554909}1431gitlab # [ 307.628430] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f292be379ebb68f70218e1b7","created_at":"2026-09-01T10:37:02.790Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8a1334250b7483935b5f4ba1738200a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.794Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f292be379ebb68f70218e1b7: done: 0.122595 sec","job_status":"done","queue_duration_s":1.554861,"scheduling_latency_s":1.554909,"redis_calls":9,"redis_duration_s":0.011962,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007772,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00113774,"exclusive_lock_hold_duration_s":0.05684942,"duration_s":0.122595,"completed_at":"2026-09-01T10:37:04.471Z","load_balancing_strategy":"primary","db_duration_s":0.051489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 307.699030] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"50bfce409a5bcec27e7c579d","created_at":"2026-09-01T10:37:02.832Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"613d865111451c035192ead890ac2203","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.856Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-50bfce409a5bcec27e7c579d: start","job_status":"start","queue_duration_s":1.685997,"scheduling_latency_s":1.68605}1433gitlab # [ 307.817759] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"50bfce409a5bcec27e7c579d","created_at":"2026-09-01T10:37:02.832Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"613d865111451c035192ead890ac2203","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.856Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-50bfce409a5bcec27e7c579d: done: 0.118449 sec","job_status":"done","queue_duration_s":1.685997,"scheduling_latency_s":1.68605,"redis_calls":7,"redis_duration_s":0.015560000000000001,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003914,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.118449,"completed_at":"2026-09-01T10:37:04.660Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 307.919472] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:04.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4d3f2f1fd682fa0de92ad09f","created_at":"2026-09-01T10:37:02.885Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f4da0dc6631fbaf13166e0ddb18c763","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.892Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4d3f2f1fd682fa0de92ad09f: start","job_status":"start","queue_duration_s":1.780223,"scheduling_latency_s":1.780272}1435gitlab # [ 309.243598] redis[788]: 10 changes in 300 seconds. Saving...1436gitlab # [ 309.244176] redis[788]: Background saving started by pid 33861437gitlab # [ 309.256640] redis[3386]: BGSAVE done, 459 keys saved, 0 keys skipped, 123687 bytes written.1438gitlab # [ 309.266010] redis[3386]: DB saved on disk1439gitlab # [ 309.268413] redis[3386]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB1440gitlab # [ 309.345453] redis[788]: Background saving terminated with success1441gitlab # [ 309.522685] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:06.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4d3f2f1fd682fa0de92ad09f","created_at":"2026-09-01T10:37:02.885Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f4da0dc6631fbaf13166e0ddb18c763","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.892Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4d3f2f1fd682fa0de92ad09f: done: 1.691555 sec","job_status":"done","queue_duration_s":1.780223,"scheduling_latency_s":1.780272,"redis_calls":562,"redis_duration_s":0.9717300000000001,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012279,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.959451,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.824721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.691555,"completed_at":"2026-09-01T10:37:06.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 309.621928] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:06.378Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6fdc6ca189cd454539382775","created_at":"2026-09-01T10:37:02.910Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddf9de55b72955e6c903f4f947a29437","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.935Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6fdc6ca189cd454539382775: start","job_status":"start","queue_duration_s":3.442652,"scheduling_latency_s":3.442707}1443gitlab # [ 309.656158] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:06.496Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6fdc6ca189cd454539382775","created_at":"2026-09-01T10:37:02.910Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddf9de55b72955e6c903f4f947a29437","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.935Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6fdc6ca189cd454539382775: done: 0.118021 sec","job_status":"done","queue_duration_s":3.442652,"scheduling_latency_s":3.442707,"redis_calls":10,"redis_duration_s":0.030617,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.019488,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.011129,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01967038,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.118021,"completed_at":"2026-09-01T10:37:06.495Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010855,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1444gitlab # [ 309.770361] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:06.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"bb553989ca9b5b7d206cd8fd","created_at":"2026-09-01T10:37:02.980Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f753cdcee1686436c9be8b8f75b4e069","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.993Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-bb553989ca9b5b7d206cd8fd: start","job_status":"start","queue_duration_s":3.62063,"scheduling_latency_s":3.620685}1445gitlab # [ 309.889670] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:06.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"bb553989ca9b5b7d206cd8fd","created_at":"2026-09-01T10:37:02.980Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f753cdcee1686436c9be8b8f75b4e069","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:02.993Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-bb553989ca9b5b7d206cd8fd: done: 0.119151 sec","job_status":"done","queue_duration_s":3.62063,"scheduling_latency_s":3.620685,"redis_calls":9,"redis_duration_s":0.020725999999999998,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013508,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007218,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0038887,"exclusive_lock_hold_duration_s":0.04672214,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.119151,"completed_at":"2026-09-01T10:37:06.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 309.984953] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:06.746Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1e5fa25a5c839fa3c9ed4e3c","created_at":"2026-09-01T10:37:03.033Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da001df61fbbe88a34c5bc490c1c7a00","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.040Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1e5fa25a5c839fa3c9ed4e3c: start","job_status":"start","queue_duration_s":3.705887,"scheduling_latency_s":3.705926}1447gitlab # [ 310.007452] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:06.779Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1448gitlab # [ 310.012598] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:06.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1e5fa25a5c839fa3c9ed4e3c","created_at":"2026-09-01T10:37:03.033Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da001df61fbbe88a34c5bc490c1c7a00","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.040Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1e5fa25a5c839fa3c9ed4e3c: done: 0.067381 sec","job_status":"done","queue_duration_s":3.705887,"scheduling_latency_s":3.705926,"redis_calls":7,"redis_duration_s":0.015514,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002969,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067381,"completed_at":"2026-09-01T10:37:06.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 310.061744] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:06.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"47f354b14e8135d49b899cc5","created_at":"2026-09-01T10:37:03.077Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d910c1bee7085336013950c352945b45","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.087Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-47f354b14e8135d49b899cc5: start","job_status":"start","queue_duration_s":3.817922,"scheduling_latency_s":3.817973}1450gitlab # [ 310.173565] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"47f354b14e8135d49b899cc5","created_at":"2026-09-01T10:37:03.077Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d910c1bee7085336013950c352945b45","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.087Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-47f354b14e8135d49b899cc5: done: 0.111189 sec","job_status":"done","queue_duration_s":3.817922,"scheduling_latency_s":3.817973,"redis_calls":9,"redis_duration_s":0.013349,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006511,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0026684,"exclusive_lock_hold_duration_s":0.00881272,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.111189,"completed_at":"2026-09-01T10:37:07.016Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 310.257395] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7ddc1856f4425db0b2f42603","created_at":"2026-09-01T10:37:03.127Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.137Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7ddc1856f4425db0b2f42603: start","job_status":"start","queue_duration_s":3.889853,"scheduling_latency_s":3.8899}1452gitlab # [ 310.683375] postgres[861]: [861] LOG: checkpoint starting: time1453gitlab # [ 310.847200] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.688Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7ddc1856f4425db0b2f42603","created_at":"2026-09-01T10:37:03.127Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.137Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7ddc1856f4425db0b2f42603: done: 0.661525 sec","job_status":"done","queue_duration_s":3.889853,"scheduling_latency_s":3.8899,"redis_calls":60,"redis_duration_s":0.178643,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.001024,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.1719,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.005719,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.661525,"completed_at":"2026-09-01T10:37:07.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 310.936316] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.692Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e2a7beac5dc28e906be3283b","created_at":"2026-09-01T10:37:03.091Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-4265572753b0478b","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.142Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e2a7beac5dc28e906be3283b: start","job_status":"start","queue_duration_s":4.549958,"scheduling_latency_s":4.549984}1455gitlab # [ 310.951554] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.705Z","message":"No existing merge request to be cleaned up."}1456gitlab # [ 310.953573] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.717Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e2a7beac5dc28e906be3283b","created_at":"2026-09-01T10:37:03.091Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-4265572753b0478b","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.142Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e2a7beac5dc28e906be3283b: done: 0.025036 sec","job_status":"done","queue_duration_s":4.549958,"scheduling_latency_s":4.549984,"redis_calls":10,"redis_duration_s":0.002673,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001582,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025036,"completed_at":"2026-09-01T10:37:07.717Z","load_balancing_strategy":"primary","db_duration_s":0.002799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 310.993867] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.718Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e30b9b941c173108bacbfe1f","created_at":"2026-09-01T10:37:03.091Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-4265572753b0478b","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.142Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e30b9b941c173108bacbfe1f: start","job_status":"start","queue_duration_s":4.576388,"scheduling_latency_s":4.576403}1458gitlab # [ 311.006214] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.731Z","message":"No existing merge request to be cleaned up."}1459gitlab # [ 311.007867] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.740Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e30b9b941c173108bacbfe1f","created_at":"2026-09-01T10:37:03.091Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-4265572753b0478b","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.142Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e30b9b941c173108bacbfe1f: done: 0.022135 sec","job_status":"done","queue_duration_s":4.576388,"scheduling_latency_s":4.576403,"redis_calls":10,"redis_duration_s":0.00255,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001484,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022135,"completed_at":"2026-09-01T10:37:07.740Z","load_balancing_strategy":"primary","db_duration_s":0.002676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 311.046124] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.743Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"57f3475283eb2798912c9922","created_at":"2026-09-01T10:37:03.091Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-4265572753b0478b","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.142Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-57f3475283eb2798912c9922: start","job_status":"start","queue_duration_s":4.600999,"scheduling_latency_s":4.601016}1461gitlab # [ 311.058309] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.761Z","message":"No existing merge request to be cleaned up."}1462gitlab # [ 311.059913] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.772Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"57f3475283eb2798912c9922","created_at":"2026-09-01T10:37:03.091Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-4265572753b0478b","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.142Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-57f3475283eb2798912c9922: done: 0.029393 sec","job_status":"done","queue_duration_s":4.600999,"scheduling_latency_s":4.601016,"redis_calls":10,"redis_duration_s":0.002922,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029393,"completed_at":"2026-09-01T10:37:07.772Z","load_balancing_strategy":"primary","db_duration_s":0.012241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 311.097444] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.773Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f170a0c6ac784cfb4022d5b5","created_at":"2026-09-01T10:37:03.091Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-4265572753b0478b","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.142Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f170a0c6ac784cfb4022d5b5: start","job_status":"start","queue_duration_s":4.631752,"scheduling_latency_s":4.631768}1464gitlab # [ 311.109510] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.786Z","message":"No existing merge request to be cleaned up."}1465gitlab # [ 311.111134] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.795Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f170a0c6ac784cfb4022d5b5","created_at":"2026-09-01T10:37:03.091Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-4265572753b0478b","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"02367d4cfa482effa4454f39c2cf2df4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.142Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f170a0c6ac784cfb4022d5b5: done: 0.021511 sec","job_status":"done","queue_duration_s":4.631752,"scheduling_latency_s":4.631768,"redis_calls":10,"redis_duration_s":0.0026179999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001037,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021511,"completed_at":"2026-09-01T10:37:07.795Z","load_balancing_strategy":"primary","db_duration_s":0.002652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 311.149566] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8e8e13ad4a172c1b624b9b5c","created_at":"2026-09-01T10:37:03.159Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1d24d7ed358ad734598119de73e8fbb","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.170Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8e8e13ad4a172c1b624b9b5c: start","job_status":"start","queue_duration_s":4.625894,"scheduling_latency_s":4.62591}1467gitlab # [ 311.163206] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.830Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8e8e13ad4a172c1b624b9b5c","created_at":"2026-09-01T10:37:03.159Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-ecbe14af70584270","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1d24d7ed358ad734598119de73e8fbb","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:03.170Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8e8e13ad4a172c1b624b9b5c: done: 0.033691 sec","job_status":"done","queue_duration_s":4.625894,"scheduling_latency_s":4.62591,"redis_calls":7,"redis_duration_s":0.002458,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001881,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.033691,"completed_at":"2026-09-01T10:37:07.830Z","load_balancing_strategy":"primary","db_duration_s":0.016489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 311.204160] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0739771fd571e485ffd33049","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0739771fd571e485ffd33049: start","job_status":"start","queue_duration_s":0.152558,"scheduling_latency_s":0.153499}1469gitlab # [ 311.216125] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0739771fd571e485ffd33049","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0739771fd571e485ffd33049: done: 0.017902 sec","job_status":"done","queue_duration_s":0.152558,"scheduling_latency_s":0.153499,"redis_calls":13,"redis_duration_s":0.002922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017902,"completed_at":"2026-09-01T10:37:07.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 311.255291] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7c9b1fc79976c29df95c57b","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7c9b1fc79976c29df95c57b: start","job_status":"start","queue_duration_s":0.171925,"scheduling_latency_s":0.17194}1471gitlab # [ 311.268104] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7c9b1fc79976c29df95c57b","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7c9b1fc79976c29df95c57b: done: 0.01651 sec","job_status":"done","queue_duration_s":0.171925,"scheduling_latency_s":0.17194,"redis_calls":13,"redis_duration_s":0.002666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001746,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01651,"completed_at":"2026-09-01T10:37:07.867Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 311.307499] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"150f6079227856c8f3c05ae8","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-150f6079227856c8f3c05ae8: start","job_status":"start","queue_duration_s":0.189862,"scheduling_latency_s":0.189877}1473gitlab # [ 311.320165] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"150f6079227856c8f3c05ae8","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-150f6079227856c8f3c05ae8: done: 0.016489 sec","job_status":"done","queue_duration_s":0.189862,"scheduling_latency_s":0.189877,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016489,"completed_at":"2026-09-01T10:37:07.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 311.359634] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aecb8ebee727beec47f201a2","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aecb8ebee727beec47f201a2: start","job_status":"start","queue_duration_s":0.207858,"scheduling_latency_s":0.207873}1475gitlab # [ 311.371926] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aecb8ebee727beec47f201a2","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aecb8ebee727beec47f201a2: done: 0.016061 sec","job_status":"done","queue_duration_s":0.207858,"scheduling_latency_s":0.207873,"redis_calls":13,"redis_duration_s":0.002534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001633,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016061,"completed_at":"2026-09-01T10:37:07.903Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 311.412206] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6cc50d871611b0cc07c009e","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6cc50d871611b0cc07c009e: start","job_status":"start","queue_duration_s":0.226986,"scheduling_latency_s":0.227002}1477gitlab # [ 311.424383] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6cc50d871611b0cc07c009e","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6cc50d871611b0cc07c009e: done: 0.015793 sec","job_status":"done","queue_duration_s":0.226986,"scheduling_latency_s":0.227002,"redis_calls":13,"redis_duration_s":0.002519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001565,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015793,"completed_at":"2026-09-01T10:37:07.922Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 311.462914] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2941169c46e601c04d87e05","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2941169c46e601c04d87e05: start","job_status":"start","queue_duration_s":0.244114,"scheduling_latency_s":0.244129}1479gitlab # [ 311.475366] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2941169c46e601c04d87e05","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2941169c46e601c04d87e05: done: 0.016116 sec","job_status":"done","queue_duration_s":0.244114,"scheduling_latency_s":0.244129,"redis_calls":13,"redis_duration_s":0.00276,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016116,"completed_at":"2026-09-01T10:37:07.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 311.514162] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e937577bc8b23a2bd77737b5","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e937577bc8b23a2bd77737b5: start","job_status":"start","queue_duration_s":0.261709,"scheduling_latency_s":0.261724}1481gitlab # [ 311.526848] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e937577bc8b23a2bd77737b5","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e937577bc8b23a2bd77737b5: done: 0.015973 sec","job_status":"done","queue_duration_s":0.261709,"scheduling_latency_s":0.261724,"redis_calls":13,"redis_duration_s":0.0027400000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015973,"completed_at":"2026-09-01T10:37:07.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 311.566895] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c0f4e19920381c1356404d","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c0f4e19920381c1356404d: start","job_status":"start","queue_duration_s":0.278847,"scheduling_latency_s":0.278863}1483gitlab # [ 311.579768] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c0f4e19920381c1356404d","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c0f4e19920381c1356404d: done: 0.016358 sec","job_status":"done","queue_duration_s":0.278847,"scheduling_latency_s":0.278863,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016358,"completed_at":"2026-09-01T10:37:07.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 311.620385] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f02180774e7394f9e49c5fe","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f02180774e7394f9e49c5fe: start","job_status":"start","queue_duration_s":0.296432,"scheduling_latency_s":0.296448}1485gitlab # [ 311.633054] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f02180774e7394f9e49c5fe","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f02180774e7394f9e49c5fe: done: 0.01535 sec","job_status":"done","queue_duration_s":0.296432,"scheduling_latency_s":0.296448,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01535,"completed_at":"2026-09-01T10:37:07.991Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 311.672409] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:07.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99183f6a5bc2d80c3b3c8e87","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99183f6a5bc2d80c3b3c8e87: start","job_status":"start","queue_duration_s":0.312895,"scheduling_latency_s":0.312912}1487gitlab # [ 311.684447] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99183f6a5bc2d80c3b3c8e87","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99183f6a5bc2d80c3b3c8e87: done: 0.015966 sec","job_status":"done","queue_duration_s":0.312895,"scheduling_latency_s":0.312912,"redis_calls":13,"redis_duration_s":0.001813,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015966,"completed_at":"2026-09-01T10:37:08.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 311.723850] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cb70048960b3b73103df21f","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cb70048960b3b73103df21f: start","job_status":"start","queue_duration_s":0.330002,"scheduling_latency_s":0.330017}1489gitlab # [ 311.736556] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cb70048960b3b73103df21f","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cb70048960b3b73103df21f: done: 0.015232 sec","job_status":"done","queue_duration_s":0.330002,"scheduling_latency_s":0.330017,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015232,"completed_at":"2026-09-01T10:37:08.024Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 311.775935] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e66cbf385597788615e3074","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e66cbf385597788615e3074: start","job_status":"start","queue_duration_s":0.347507,"scheduling_latency_s":0.347523}1491gitlab # [ 311.788534] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e66cbf385597788615e3074","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e66cbf385597788615e3074: done: 0.015793 sec","job_status":"done","queue_duration_s":0.347507,"scheduling_latency_s":0.347523,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015793,"completed_at":"2026-09-01T10:37:08.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 311.828508] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86776c8f09917f42a503b0fb","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86776c8f09917f42a503b0fb: start","job_status":"start","queue_duration_s":0.364353,"scheduling_latency_s":0.364369}1493gitlab # [ 311.840343] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86776c8f09917f42a503b0fb","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86776c8f09917f42a503b0fb: done: 0.015349 sec","job_status":"done","queue_duration_s":0.364353,"scheduling_latency_s":0.364369,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015349,"completed_at":"2026-09-01T10:37:08.059Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 311.878800] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8492397619774d2d94ee63d8","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8492397619774d2d94ee63d8: start","job_status":"start","queue_duration_s":0.380742,"scheduling_latency_s":0.380758}1495gitlab # [ 311.891367] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8492397619774d2d94ee63d8","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8492397619774d2d94ee63d8: done: 0.015486 sec","job_status":"done","queue_duration_s":0.380742,"scheduling_latency_s":0.380758,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015486,"completed_at":"2026-09-01T10:37:08.075Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 311.930765] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42e9b165b698353805cb24a5","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42e9b165b698353805cb24a5: start","job_status":"start","queue_duration_s":0.39737,"scheduling_latency_s":0.397386}1497gitlab # [ 311.943283] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42e9b165b698353805cb24a5","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42e9b165b698353805cb24a5: done: 0.021351 sec","job_status":"done","queue_duration_s":0.39737,"scheduling_latency_s":0.397386,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021351,"completed_at":"2026-09-01T10:37:08.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 311.982092] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f5a7da6bd8e53872ae131a3","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f5a7da6bd8e53872ae131a3: start","job_status":"start","queue_duration_s":0.420664,"scheduling_latency_s":0.42068}1499gitlab # [ 311.994384] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f5a7da6bd8e53872ae131a3","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f5a7da6bd8e53872ae131a3: done: 0.015354 sec","job_status":"done","queue_duration_s":0.420664,"scheduling_latency_s":0.42068,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015354,"completed_at":"2026-09-01T10:37:08.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 312.033928] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2172c690306ba31d5ccfe055","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2172c690306ba31d5ccfe055: start","job_status":"start","queue_duration_s":0.437123,"scheduling_latency_s":0.43714}1501gitlab # [ 312.046341] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2172c690306ba31d5ccfe055","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2172c690306ba31d5ccfe055: done: 0.014784 sec","job_status":"done","queue_duration_s":0.437123,"scheduling_latency_s":0.43714,"redis_calls":13,"redis_duration_s":0.001377,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014784,"completed_at":"2026-09-01T10:37:08.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 312.084830] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c9930355dbfef9f3b366dc2","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c9930355dbfef9f3b366dc2: start","job_status":"start","queue_duration_s":0.452948,"scheduling_latency_s":0.452965}1503gitlab # [ 312.097017] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c9930355dbfef9f3b366dc2","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c9930355dbfef9f3b366dc2: done: 0.014835 sec","job_status":"done","queue_duration_s":0.452948,"scheduling_latency_s":0.452965,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014835,"completed_at":"2026-09-01T10:37:08.147Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 312.135723] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3373f09b4892840f5cfba629","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3373f09b4892840f5cfba629: start","job_status":"start","queue_duration_s":0.468852,"scheduling_latency_s":0.468868}1505gitlab # [ 312.148080] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3373f09b4892840f5cfba629","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3373f09b4892840f5cfba629: done: 0.014631 sec","job_status":"done","queue_duration_s":0.468852,"scheduling_latency_s":0.468868,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014631,"completed_at":"2026-09-01T10:37:08.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 312.185880] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f751e8907d576f1d7248d60","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f751e8907d576f1d7248d60: start","job_status":"start","queue_duration_s":0.485,"scheduling_latency_s":0.485015}1507gitlab # [ 312.198011] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f751e8907d576f1d7248d60","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f751e8907d576f1d7248d60: done: 0.014596 sec","job_status":"done","queue_duration_s":0.485,"scheduling_latency_s":0.485015,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014596,"completed_at":"2026-09-01T10:37:08.179Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 312.237366] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7e20da88e02741b1aa7ef6a","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7e20da88e02741b1aa7ef6a: start","job_status":"start","queue_duration_s":0.500657,"scheduling_latency_s":0.500672}1509gitlab # [ 312.250058] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7e20da88e02741b1aa7ef6a","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7e20da88e02741b1aa7ef6a: done: 0.014345 sec","job_status":"done","queue_duration_s":0.500657,"scheduling_latency_s":0.500672,"redis_calls":13,"redis_duration_s":0.001368,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014345,"completed_at":"2026-09-01T10:37:08.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 312.288456] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f5a2a236ec48aa7f537bbaf","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f5a2a236ec48aa7f537bbaf: start","job_status":"start","queue_duration_s":0.516064,"scheduling_latency_s":0.51608}1511gitlab # [ 312.300619] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f5a2a236ec48aa7f537bbaf","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f5a2a236ec48aa7f537bbaf: done: 0.015111 sec","job_status":"done","queue_duration_s":0.516064,"scheduling_latency_s":0.51608,"redis_calls":13,"redis_duration_s":0.001635,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015111,"completed_at":"2026-09-01T10:37:08.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 312.339193] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8656f0c99f18cdd968dd6c4","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8656f0c99f18cdd968dd6c4: start","job_status":"start","queue_duration_s":0.532261,"scheduling_latency_s":0.532277}1513gitlab # [ 312.351682] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8656f0c99f18cdd968dd6c4","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8656f0c99f18cdd968dd6c4: done: 0.014975 sec","job_status":"done","queue_duration_s":0.532261,"scheduling_latency_s":0.532277,"redis_calls":13,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014975,"completed_at":"2026-09-01T10:37:08.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 312.390747] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12e7056de7cd91f813ecadd4","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12e7056de7cd91f813ecadd4: start","job_status":"start","queue_duration_s":0.548684,"scheduling_latency_s":0.548702}1515gitlab # [ 312.403171] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12e7056de7cd91f813ecadd4","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12e7056de7cd91f813ecadd4: done: 0.014624 sec","job_status":"done","queue_duration_s":0.548684,"scheduling_latency_s":0.548702,"redis_calls":13,"redis_duration_s":0.001379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014624,"completed_at":"2026-09-01T10:37:08.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 312.442956] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44ac3c4d9cccd61f51ee5597","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44ac3c4d9cccd61f51ee5597: start","job_status":"start","queue_duration_s":0.564367,"scheduling_latency_s":0.564384}1517gitlab # [ 312.455416] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44ac3c4d9cccd61f51ee5597","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44ac3c4d9cccd61f51ee5597: done: 0.01494 sec","job_status":"done","queue_duration_s":0.564367,"scheduling_latency_s":0.564384,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01494,"completed_at":"2026-09-01T10:37:08.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 312.495245] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d51358d7c3f5657de62d71c","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d51358d7c3f5657de62d71c: start","job_status":"start","queue_duration_s":0.580343,"scheduling_latency_s":0.580359}1519gitlab # [ 312.507871] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d51358d7c3f5657de62d71c","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d51358d7c3f5657de62d71c: done: 0.01458 sec","job_status":"done","queue_duration_s":0.580343,"scheduling_latency_s":0.580359,"redis_calls":13,"redis_duration_s":0.0018340000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001329,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01458,"completed_at":"2026-09-01T10:37:08.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 312.547683] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"708b58f42533dd1561c38772","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-708b58f42533dd1561c38772: start","job_status":"start","queue_duration_s":0.596076,"scheduling_latency_s":0.596092}1521gitlab # [ 312.560729] gitaly[922]: time="2026-09-01T10:37:09.342Z" level=info msg="burden monitor stats" pid=9221522gitlab # [ 312.561992] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"708b58f42533dd1561c38772","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-708b58f42533dd1561c38772: done: 0.014805 sec","job_status":"done","queue_duration_s":0.596076,"scheduling_latency_s":0.596092,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014805,"completed_at":"2026-09-01T10:37:08.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 312.600956] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb3b4b9c627437fd37c23e25","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb3b4b9c627437fd37c23e25: start","job_status":"start","queue_duration_s":0.611964,"scheduling_latency_s":0.611981}1524gitlab # [ 312.613199] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb3b4b9c627437fd37c23e25","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb3b4b9c627437fd37c23e25: done: 0.01523 sec","job_status":"done","queue_duration_s":0.611964,"scheduling_latency_s":0.611981,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01523,"completed_at":"2026-09-01T10:37:08.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 312.652339] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1363e367d7e820d34a9a340","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1363e367d7e820d34a9a340: start","job_status":"start","queue_duration_s":0.628721,"scheduling_latency_s":0.628737}1526gitlab # [ 312.664247] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1363e367d7e820d34a9a340","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1363e367d7e820d34a9a340: done: 0.015043 sec","job_status":"done","queue_duration_s":0.628721,"scheduling_latency_s":0.628737,"redis_calls":13,"redis_duration_s":0.001407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015043,"completed_at":"2026-09-01T10:37:08.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 312.702340] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b63fa04595192ede185bef4","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b63fa04595192ede185bef4: start","job_status":"start","queue_duration_s":0.644803,"scheduling_latency_s":0.644819}1528gitlab # [ 312.714605] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b63fa04595192ede185bef4","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b63fa04595192ede185bef4: done: 0.014357 sec","job_status":"done","queue_duration_s":0.644803,"scheduling_latency_s":0.644819,"redis_calls":13,"redis_duration_s":0.001407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014357,"completed_at":"2026-09-01T10:37:08.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 312.752793] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d151971ab461d5d41ee127bd","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d151971ab461d5d41ee127bd: start","job_status":"start","queue_duration_s":0.660216,"scheduling_latency_s":0.660233}1530gitlab # [ 312.764959] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d151971ab461d5d41ee127bd","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d151971ab461d5d41ee127bd: done: 0.014386 sec","job_status":"done","queue_duration_s":0.660216,"scheduling_latency_s":0.660233,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014386,"completed_at":"2026-09-01T10:37:08.354Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 312.804695] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d5dc92f2260919385a8f195","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d5dc92f2260919385a8f195: start","job_status":"start","queue_duration_s":0.675669,"scheduling_latency_s":0.675685}1532gitlab # [ 312.817315] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d5dc92f2260919385a8f195","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d5dc92f2260919385a8f195: done: 0.014881 sec","job_status":"done","queue_duration_s":0.675669,"scheduling_latency_s":0.675685,"redis_calls":13,"redis_duration_s":0.001403,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014881,"completed_at":"2026-09-01T10:37:08.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 312.857859] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aae3d04ff72d03dfb21f1838","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aae3d04ff72d03dfb21f1838: start","job_status":"start","queue_duration_s":0.691732,"scheduling_latency_s":0.691748}1534gitlab # [ 312.870269] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aae3d04ff72d03dfb21f1838","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aae3d04ff72d03dfb21f1838: done: 0.014633 sec","job_status":"done","queue_duration_s":0.691732,"scheduling_latency_s":0.691748,"redis_calls":13,"redis_duration_s":0.001408,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014633,"completed_at":"2026-09-01T10:37:08.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 312.909309] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bc07e8ed5dc0f34818d52ef","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bc07e8ed5dc0f34818d52ef: start","job_status":"start","queue_duration_s":0.707446,"scheduling_latency_s":0.707462}1536gitlab # [ 312.921758] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bc07e8ed5dc0f34818d52ef","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bc07e8ed5dc0f34818d52ef: done: 0.014332 sec","job_status":"done","queue_duration_s":0.707446,"scheduling_latency_s":0.707462,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014332,"completed_at":"2026-09-01T10:37:08.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 312.960346] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7e630fa2cf03aa8c6ca87ae","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7e630fa2cf03aa8c6ca87ae: start","job_status":"start","queue_duration_s":0.722845,"scheduling_latency_s":0.722861}1538gitlab # [ 312.972606] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7e630fa2cf03aa8c6ca87ae","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7e630fa2cf03aa8c6ca87ae: done: 0.014759 sec","job_status":"done","queue_duration_s":0.722845,"scheduling_latency_s":0.722861,"redis_calls":13,"redis_duration_s":0.001375,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014759,"completed_at":"2026-09-01T10:37:08.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 313.011109] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a777c24f98e8617551ef9cf3","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a777c24f98e8617551ef9cf3: start","job_status":"start","queue_duration_s":0.740808,"scheduling_latency_s":0.740825}1540gitlab # [ 313.023639] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a777c24f98e8617551ef9cf3","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a777c24f98e8617551ef9cf3: done: 0.020162 sec","job_status":"done","queue_duration_s":0.740808,"scheduling_latency_s":0.740825,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020162,"completed_at":"2026-09-01T10:37:08.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 313.063622] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a5c81c31d0697322c468c6","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a5c81c31d0697322c468c6: start","job_status":"start","queue_duration_s":0.762114,"scheduling_latency_s":0.76213}1542gitlab # [ 313.076110] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a5c81c31d0697322c468c6","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a5c81c31d0697322c468c6: done: 0.014592 sec","job_status":"done","queue_duration_s":0.762114,"scheduling_latency_s":0.76213,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014592,"completed_at":"2026-09-01T10:37:08.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 313.114652] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adb05a0e9cee8de05f1b9e15","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adb05a0e9cee8de05f1b9e15: start","job_status":"start","queue_duration_s":0.777779,"scheduling_latency_s":0.777794}1544gitlab # [ 313.126989] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adb05a0e9cee8de05f1b9e15","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adb05a0e9cee8de05f1b9e15: done: 0.014996 sec","job_status":"done","queue_duration_s":0.777779,"scheduling_latency_s":0.777794,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014996,"completed_at":"2026-09-01T10:37:08.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 313.165601] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8e61835c82c1d291b1b272b","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8e61835c82c1d291b1b272b: start","job_status":"start","queue_duration_s":0.793845,"scheduling_latency_s":0.793862}1546gitlab # [ 313.177912] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8e61835c82c1d291b1b272b","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8e61835c82c1d291b1b272b: done: 0.014157 sec","job_status":"done","queue_duration_s":0.793845,"scheduling_latency_s":0.793862,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014157,"completed_at":"2026-09-01T10:37:08.487Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 313.216444] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2672bbb7cedf384b7840424b","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2672bbb7cedf384b7840424b: start","job_status":"start","queue_duration_s":0.809514,"scheduling_latency_s":0.80953}1548gitlab # [ 313.229872] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2672bbb7cedf384b7840424b","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2672bbb7cedf384b7840424b: done: 0.014774 sec","job_status":"done","queue_duration_s":0.809514,"scheduling_latency_s":0.80953,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014774,"completed_at":"2026-09-01T10:37:08.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 313.269003] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e20306c89335a76d83c0528c","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e20306c89335a76d83c0528c: start","job_status":"start","queue_duration_s":0.825397,"scheduling_latency_s":0.825413}1550gitlab # [ 313.281046] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e20306c89335a76d83c0528c","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e20306c89335a76d83c0528c: done: 0.014652 sec","job_status":"done","queue_duration_s":0.825397,"scheduling_latency_s":0.825413,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014652,"completed_at":"2026-09-01T10:37:08.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 313.319858] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ceef224c79a0b7ed6e4f16d","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ceef224c79a0b7ed6e4f16d: start","job_status":"start","queue_duration_s":0.841122,"scheduling_latency_s":0.841137}1552gitlab # [ 313.332327] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ceef224c79a0b7ed6e4f16d","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ceef224c79a0b7ed6e4f16d: done: 0.014266 sec","job_status":"done","queue_duration_s":0.841122,"scheduling_latency_s":0.841137,"redis_calls":13,"redis_duration_s":0.001372,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014266,"completed_at":"2026-09-01T10:37:08.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 313.370571] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9810d5f301458615020ac1a3","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9810d5f301458615020ac1a3: start","job_status":"start","queue_duration_s":0.856686,"scheduling_latency_s":0.856702}1554gitlab # [ 313.382943] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9810d5f301458615020ac1a3","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9810d5f301458615020ac1a3: done: 0.014172 sec","job_status":"done","queue_duration_s":0.856686,"scheduling_latency_s":0.856702,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014172,"completed_at":"2026-09-01T10:37:08.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 313.421503] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80a846a63424d30b9bba038f","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80a846a63424d30b9bba038f: start","job_status":"start","queue_duration_s":0.872158,"scheduling_latency_s":0.872175}1556gitlab # [ 313.434835] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80a846a63424d30b9bba038f","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80a846a63424d30b9bba038f: done: 0.014374 sec","job_status":"done","queue_duration_s":0.872158,"scheduling_latency_s":0.872175,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014374,"completed_at":"2026-09-01T10:37:08.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 313.473630] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d396348137516dc700e61a1","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d396348137516dc700e61a1: start","job_status":"start","queue_duration_s":0.887687,"scheduling_latency_s":0.887704}1558gitlab # [ 313.486053] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d396348137516dc700e61a1","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d396348137516dc700e61a1: done: 0.014773 sec","job_status":"done","queue_duration_s":0.887687,"scheduling_latency_s":0.887704,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014773,"completed_at":"2026-09-01T10:37:08.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 313.524632] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c948faa2c77dbd7e94c03f4","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c948faa2c77dbd7e94c03f4: start","job_status":"start","queue_duration_s":0.903776,"scheduling_latency_s":0.903793}1560gitlab # [ 313.536888] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c948faa2c77dbd7e94c03f4","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c948faa2c77dbd7e94c03f4: done: 0.015685 sec","job_status":"done","queue_duration_s":0.903776,"scheduling_latency_s":0.903793,"redis_calls":13,"redis_duration_s":0.001629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015685,"completed_at":"2026-09-01T10:37:08.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 313.575467] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41acb217db1d0f9d1d10b506","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41acb217db1d0f9d1d10b506: start","job_status":"start","queue_duration_s":0.920541,"scheduling_latency_s":0.920557}1562gitlab # [ 313.587943] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41acb217db1d0f9d1d10b506","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41acb217db1d0f9d1d10b506: done: 0.01532 sec","job_status":"done","queue_duration_s":0.920541,"scheduling_latency_s":0.920557,"redis_calls":13,"redis_duration_s":0.001564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01532,"completed_at":"2026-09-01T10:37:08.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 313.628060] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbd767acbb9c7d315f4485ac","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbd767acbb9c7d315f4485ac: start","job_status":"start","queue_duration_s":0.936981,"scheduling_latency_s":0.936996}1564gitlab # [ 313.641563] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbd767acbb9c7d315f4485ac","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbd767acbb9c7d315f4485ac: done: 0.014605 sec","job_status":"done","queue_duration_s":0.936981,"scheduling_latency_s":0.936996,"redis_calls":13,"redis_duration_s":0.0014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014605,"completed_at":"2026-09-01T10:37:08.631Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 313.680617] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5e86c7d57de6a7962f159de","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5e86c7d57de6a7962f159de: start","job_status":"start","queue_duration_s":0.952658,"scheduling_latency_s":0.952674}1566gitlab # [ 313.692886] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5e86c7d57de6a7962f159de","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5e86c7d57de6a7962f159de: done: 0.014283 sec","job_status":"done","queue_duration_s":0.952658,"scheduling_latency_s":0.952674,"redis_calls":13,"redis_duration_s":0.00139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014283,"completed_at":"2026-09-01T10:37:08.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 313.731656] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c0edaa49a07ec065b2fd579","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c0edaa49a07ec065b2fd579: start","job_status":"start","queue_duration_s":0.968106,"scheduling_latency_s":0.968122}1568gitlab # [ 313.743915] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:08.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c0edaa49a07ec065b2fd579","created_at":"2026-09-01T10:37:07.067Z","trace_propagation_headers":{"sentry-trace":"06994901c96549bca434c396c5943f77-3cb589c82b1348ae","baggage":"sentry-trace_id=06994901c96549bca434c396c5943f77,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b7434e6dd98098651d6f90373de2c1ee","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:07.679Z","job_size_bytes":2,"pid":2046,"sidekiq_tid":"mao2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c0edaa49a07ec065b2fd579: done: 0.014475 sec","job_status":"done","queue_duration_s":0.968106,"scheduling_latency_s":0.968122,"redis_calls":13,"redis_duration_s":0.0014269999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014475,"completed_at":"2026-09-01T10:37:08.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 338.214900] postgres[3481]: [3481] ERROR: relation "table_without_models" does not exist1570gitlab # [ 338.216772] postgres[3481]: [3481] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1571gitlab # [ 344.354762] runuser[3133]: pam_unix(runuser:session): session closed for user gitlab1572gitlab # [ 344.356712] setup-gitlab-start[3103]: + systemctl restart gitlab-sidekiq.service1573gitlab # [ 344.390268] systemd[1]: Stopping gitlab-sidekiq.service...1574gitlab # [ 344.396665] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:41.233Z","message":"Shutting down"}1575gitlab # [ 344.400877] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:41.234Z","message":"Scheduler exiting..."}1576gitlab # [ 344.405172] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:41.235Z","message":"Terminating quiet threads for default capsule"}1577gitlab # [ 344.410311] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:41.235Z","message":"Scheduler exiting..."}1578gitlab # [ 344.892113] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:41.736Z","message":"Pausing to allow jobs to finish..."}1579gitlab # [ 347.397010] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:44.239Z","message":"Bye!"}1580gitlab # [ 347.439026] sidekiq-cluster[2046]: {"severity":"INFO","time":"2026-09-01T10:37:44.282Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2046,"worker_id":"sidekiq_0","memwd_rss_bytes":957145088,"retry":0}1581gitlab # [ 348.617254] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1582gitlab # [ 348.617727] systemd[1]: Stopped gitlab-sidekiq.service.1583gitlab # [ 348.617934] systemd[1]: gitlab-sidekiq.service: Consumed 2min 12.230s CPU time over 3min 43.694s wall clock time, 947M memory peak, 4.5M read from disk.1584gitlab # [ 348.631463] systemd[1]: Started gitlab-sidekiq.service.1585gitlab # [ 348.635195] setup-gitlab-start[3103]: + mkdir -p /var/lib/secrets1586gitlab # [ 348.639733] setup-gitlab-start[3103]: + echo nixbot-test-token-of-20-chars1587gitlab # [ 348.642913] setup-gitlab-start[3103]: + chmod 644 /var/lib/secrets/gitlab-token1588gitlab # [ 348.646583] setup-gitlab-start[3103]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1589gitlab # [ 349.925699] gitaly[922]: time="2026-09-01T10:37:46.768Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:56.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:46.768" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 349.926208] gitaly[922]: time="2026-09-01T10:37:46.769Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:56.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:46.768" grpc.time_ms=1.111 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 350.169132] gitaly[922]: time="2026-09-01T10:37:47.013Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:57.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.013" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 350.199319] gitaly[922]: time="2026-09-01T10:37:47.013Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:57.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.013" grpc.time_ms=0.608 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 350.251953] gitaly[922]: time="2026-09-01T10:37:47.096Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H diskcache=e5182beb-20bd-4881-b2c1-ab3ff7a84216 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:37:57.018" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.029" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 350.282155] gitaly[922]: time="2026-09-01T10:37:47.097Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=34 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1441 command.oublock=32 command.real_time_ms=42 command.spawn_token_fork_ms=6 command.system_time_ms=25 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:37:57.018" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.029" grpc.time_ms=67.198 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 350.309591] gitaly[922]: time="2026-09-01T10:37:47.123Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:57.111" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.122" pid=922 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1596gitlab # [ 350.326647] gitaly[922]: time="2026-09-01T10:37:47.124Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:57.111" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.122" grpc.time_ms=1.427 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 350.344250] gitaly[922]: time="2026-09-01T10:37:47.146Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:37:57.120" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.131" grpc.time_ms=14.995 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1598gitlab # [ 350.400047] gitaly[922]: time="2026-09-01T10:37:47.244Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:57.233" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.244" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1599gitlab # [ 350.423877] gitaly[922]: time="2026-09-01T10:37:47.245Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:57.233" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.244" grpc.time_ms=1.164 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1600gitlab # [ 350.461203] gitaly[922]: time="2026-09-01T10:37:47.305Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H diskcache=ae96f0ba-7744-46d6-85aa-0cd535933ab6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:37:57.237" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.248" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1601gitlab # [ 350.480787] gitaly[922]: time="2026-09-01T10:37:47.305Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=37 command.spawn_token_fork_ms=7 command.system_time_ms=31 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-01T10:37:57.237" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.248" grpc.time_ms=57.748 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1602gitlab # [ 350.501862] gitaly[922]: time="2026-09-01T10:37:47.317Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:57.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.317" pid=922 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1603gitlab # [ 350.515428] gitaly[922]: time="2026-09-01T10:37:47.318Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:57.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.317" grpc.time_ms=1.129 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1604gitlab # [ 350.527842] gitaly[922]: time="2026-09-01T10:37:47.341Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:37:57.014" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.325" grpc.time_ms=16.484 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1605gitlab # [ 350.555422] gitaly[922]: time="2026-09-01T10:37:47.399Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:37:57.088" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.399" grpc.time_ms=0.289 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 350.582074] gitaly[922]: time="2026-09-01T10:37:47.423Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:37:57.111" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:47.422" grpc.time_ms=0.577 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 351.376058] gitaly[922]: time="2026-09-01T10:37:48.219Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QQNEHE80XN13TN8R5Q4H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:37:58.190" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:48.201" grpc.time_ms=17.856 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 352.040534] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:48 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 33651609gitlab # [ 352.046840] setup-gitlab-start[3103]: + mkdir -p /tmp/test-flake1610gitlab # [ 352.051053] setup-gitlab-start[3103]: + cd /tmp/test-flake1611gitlab # [ 352.053604] setup-gitlab-start[3103]: + git init -b master1612gitlab # [ 352.088693] setup-gitlab-start[3600]: Initialized empty Git repository in /tmp/test-flake/.git/1613gitlab # [ 352.092298] setup-gitlab-start[3103]: + git config user.name test1614gitlab # [ 352.096221] setup-gitlab-start[3103]: + git config user.email test@example.com1615gitlab # [ 352.103242] setup-gitlab-start[3103]: + cat1616gitlab # [ 352.108986] setup-gitlab-start[3103]: + git add flake.nix1617gitlab # [ 352.117540] setup-gitlab-start[3103]: + git commit -m 'initial commit'1618gitlab # [ 352.157048] setup-gitlab-start[3605]: [master (root-commit) df1df45] initial commit1619gitlab # [ 352.160358] setup-gitlab-start[3605]: 1 file changed, 10 insertions(+)1620gitlab # [ 352.163076] setup-gitlab-start[3605]: create mode 100644 flake.nix1621gitlab # [ 352.165837] setup-gitlab-start[3103]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1622gitlab # [ 352.173568] setup-gitlab-start[3103]: + git push -u origin master1623gitlab # [ 352.551013] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 3241624gitlab # [ 353.416208] gitaly[922]: time="2026-09-01T10:37:50.260Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QVETG63YWPQM8PCB1PGA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:50.240" grpc.time_ms=19.71 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 353.430574] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:50 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 8591626gitlab # [ 353.758477] sidekiq-cluster[3547]: {"severity":"INFO","time":"2026-09-01T10:37:50.573Z","message":"Starting cluster with 1 processes"}1627gitlab # [ 353.883938] gitaly[922]: time="2026-09-01T10:37:50.728Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:38:00.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:50.710" grpc.time_ms=17.884 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1628gitlab # [ 353.964477] gitaly[922]: time="2026-09-01T10:37:50.808Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-01T10:38:20.088" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-01T10:37:50.788" grpc.time_ms=19.629 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1629gitlab # [ 354.010072] gitaly[922]: time="2026-09-01T10:37:50.854Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1E8QWABT18F7BR2MHWWHN4E duration_ms=267ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/allowed"1630gitlab # [ 354.116127] gitaly[922]: time="2026-09-01T10:37:50.960Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1E8QWABT18F7BR2MHWWHN4E duration_ms=104ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/pre_receive"1631gitlab # [ 354.125327] gitaly[922]: time="2026-09-01T10:37:50.961Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:50.584" grpc.time_ms=376.106 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1632gitlab # [ 354.173487] gitaly[922]: time="2026-09-01T10:37:51.017Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:51.016" grpc.time_ms=1.451 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1633gitlab # [ 354.245384] gitaly[922]: time="2026-09-01T10:37:51.089Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:51.088" grpc.time_ms=1.057 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1634gitlab # [ 354.297946] gitaly[922]: time="2026-09-01T10:37:51.142Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:51.141" grpc.time_ms=0.935 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1635gitlab # [ 354.584487] gitaly[922]: time="2026-09-01T10:37:51.428Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:38:01.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:51.410" grpc.time_ms=17.575 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1636gitlab # [ 354.659795] gitaly[922]: time="2026-09-01T10:37:51.504Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1433 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=5 command.system_time_ms=28 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-01T10:38:01.062" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:51.463" grpc.time_ms=40.442 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1637gitlab # [ 354.705813] gitaly[922]: time="2026-09-01T10:37:51.549Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1E8QWABT18F7BR2MHWWHN4E duration_ms=360ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/post_receive"1638gitlab # [ 354.711208] gitaly[922]: time="2026-09-01T10:37:51.550Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:51.187" grpc.time_ms=362.383 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1639gitlab # [ 354.734836] gitaly[922]: time="2026-09-01T10:37:51.579Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E diskcache=b935e3f1-e22a-4ea6-9186-95c58b878ad2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:50.464" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1640gitlab # [ 354.772667] gitaly[922]: time="2026-09-01T10:37:51.579Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=332 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13327 command.oublock=32 command.real_time_ms=1105 command.spawn_token_fork_ms=1 command.system_time_ms=202 command.user_time_ms=130 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:50.464" grpc.time_ms=1114.926 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1641gitlab # [ 354.802530] systemd[1]: Finished setup-gitlab.service.1642gitlab # [ 354.804071] setup-gitlab-start[3609]: To http://gitlab/root/test-flake.git1643gitlab # [ 354.805713] setup-gitlab-start[3609]: * [new branch] master -> master1644gitlab # [ 354.807292] setup-gitlab-start[3609]: branch 'master' set up to track 'origin/master'.1645gitlab # [ 354.809765] gitlab-workhorse[820]: time="2026-09-01T10:37:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521646gitlab # [ 354.813054] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:51 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12961647gitlab # [ 354.816363] systemd[1]: Starting nixbot CI service...1648gitlab: (finished: waiting for unit setup-gitlab.service, in 355.45 seconds)1649gitlab: waiting for unit nixbot.service1650gitlab # [ 356.041295] nixbot[3708]: {"ts": "2026-09-01T10:37:52.884Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1651gitlab # [ 356.083513] nixbot[3708]: {"ts": "2026-09-01T10:37:52.927Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1652gitlab # [ 356.102560] nixbot[3708]: {"ts": "2026-09-01T10:37:52.946Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1653gitlab # [ 356.109362] nixbot[3708]: {"ts": "2026-09-01T10:37:52.951Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1654gitlab # [ 356.116209] nixbot[3708]: {"ts": "2026-09-01T10:37:52.956Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1655gitlab # [ 356.122518] nixbot[3708]: {"ts": "2026-09-01T10:37:52.963Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1656gitlab # [ 356.129167] nixbot[3708]: {"ts": "2026-09-01T10:37:52.966Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1657gitlab # [ 356.135678] nixbot[3708]: {"ts": "2026-09-01T10:37:52.968Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1658gitlab # [ 356.142037] nixbot[3708]: {"ts": "2026-09-01T10:37:52.974Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1659gitlab # [ 356.148472] nixbot[3708]: {"ts": "2026-09-01T10:37:52.976Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1660gitlab # [ 356.155113] nixbot[3708]: {"ts": "2026-09-01T10:37:52.981Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1661gitlab # [ 356.161446] nixbot[3708]: {"ts": "2026-09-01T10:37:52.987Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1662gitlab # [ 356.167461] nixbot[3708]: {"ts": "2026-09-01T10:37:52.991Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1663gitlab # [ 356.173557] nixbot[3708]: {"ts": "2026-09-01T10:37:52.993Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1664gitlab # [ 356.179413] nixbot[3708]: {"ts": "2026-09-01T10:37:52.998Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1665gitlab # [ 356.185264] nixbot[3708]: {"ts": "2026-09-01T10:37:53.000Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1666gitlab # [ 356.190544] nixbot[3708]: {"ts": "2026-09-01T10:37:53.002Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1667gitlab # [ 356.195436] nixbot[3708]: {"ts": "2026-09-01T10:37:53.004Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1668gitlab # [ 356.199770] nixbot[3708]: {"ts": "2026-09-01T10:37:53.009Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1669gitlab # [ 356.203901] nixbot[3708]: {"ts": "2026-09-01T10:37:53.011Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1670gitlab # [ 356.211163] nixbot[3708]: {"ts": "2026-09-01T10:37:53.012Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1671gitlab # [ 356.218343] nixbot[3708]: {"ts": "2026-09-01T10:37:53.018Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1672gitlab # [ 356.224835] nixbot[3708]: {"ts": "2026-09-01T10:37:53.020Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1673gitlab # [ 356.228110] nixbot[3708]: {"ts": "2026-09-01T10:37:53.022Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1674gitlab # [ 356.231189] nixbot[3708]: {"ts": "2026-09-01T10:37:53.023Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1675gitlab # [ 356.234239] nixbot[3708]: {"ts": "2026-09-01T10:37:53.025Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1676gitlab # [ 356.237346] nixbot[3708]: {"ts": "2026-09-01T10:37:53.027Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1677gitlab # [ 356.240360] nixbot[3708]: {"ts": "2026-09-01T10:37:53.029Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1678gitlab # [ 356.690564] nixbot[3708]: INFO: Started server process [3708]1679gitlab # [ 356.696530] nixbot[3708]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1680gitlab # [ 356.712049] nixbot[3708]: INFO: ::ffff:127.0.0.1:58264 - "GET /health HTTP/1.1" 200 OK1681gitlab # [ 356.719193] systemd[1]: Started nixbot CI service.1682gitlab # [ 356.721069] systemd[1]: Reached target Multi-User System.1683gitlab # [ 356.723848] systemd[1]: Startup finished in 764ms (kernel) + 4.273s (initrd) + 5min 51.685s (userspace) = 5min 56.723s.1684gitlab # [ 357.126984] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:53 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4141685gitlab: (finished: waiting for unit nixbot.service, in 2.15 seconds)1686gitlab # [ 357.135072] nixbot[3708]: {"ts": "2026-09-01T10:37:53.975Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1687gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1688gitlab # [ 357.192122] nixbot[3708]: {"ts": "2026-09-01T10:37:54.036Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1689gitlab # [ 357.205969] nixbot[3708]: INFO: ::ffff:127.0.0.1:58272 - "GET /health HTTP/1.1" 200 OK1690gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1691subtest: project discovered and webhook registered1692gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1693gitlab # [ 357.352769] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 951694gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds)1695gitlab # [ 357.379767] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1561696gitlab # [ 357.386507] nixbot[3708]: {"ts": "2026-09-01T10:37:54.225Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1697gitlab # [ 357.393722] nixbot[3708]: {"ts": "2026-09-01T10:37:54.228Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1698gitlab # [ 357.650932] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2621699gitlab # [ 357.657799] nixbot[3708]: {"ts": "2026-09-01T10:37:54.497Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1700gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1701gitlab # [ 358.525533] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1141702gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds)1703(finished: subtest: project discovered and webhook registered, in 1.32 seconds)1704subtest: push delivers the webhook1705gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1706gitlab # [ 358.547753] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:55 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 8791707gitlab # [ 358.551650] nixbot[3708]: {"ts": "2026-09-01T10:37:55.395Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1708gitlab # [ 358.640236] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 691709gitlab # [ 358.646810] nixbot[3708]: {"ts": "2026-09-01T10:37:55.483Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1710gitlab # [ 358.687961] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 641711gitlab # [ 358.710742] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:55 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 671712gitlab # [ 358.718876] nixbot[3708]: {"ts": "2026-09-01T10:37:55.555Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1713gitlab # [ 358.786387] gitaly[922]: time="2026-09-01T10:37:55.630Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1F9TRBZKWWJJ28S1SC2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-01T10:38:25.015" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:55.615" grpc.time_ms=14.089 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1714gitlab # [ 358.812767] gitaly[922]: time="2026-09-01T10:37:55.657Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1EK38W67GWM9FVFV02K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:55.645" grpc.time_ms=12.037 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1715gitlab # [ 358.831389] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1181716gitlab # Enumerating objects: 5, done.1717gitlab # [ 358.834296] gitaly[922]: time="2026-09-01T10:37:55.676Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1F9TRBZKWWJJ28S1SC2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:25.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:55.674" grpc.time_ms=1.458 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1718gitlab # Counting objects: 20% (1/5)[ 358.849235] gitaly[922]: time="2026-09-01T10:37:55.693Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1F9TRBZKWWJJ28S1SC2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-01T10:38:05.002" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:55.682" grpc.time_ms=9.959 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1719gitlab # Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1720gitlab # Delta compression using up to 4 threads1721gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1722gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1723gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1724gitlab # [ 358.901469] nixbot[3708]: {"ts": "2026-09-01T10:37:55.745Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1725gitlab # [ 358.904675] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1851726gitlab # [ 359.033495] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1291727gitlab # [ 359.038278] nixbot[3708]: {"ts": "2026-09-01T10:37:55.879Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1728gitlab # [ 359.042830] nixbot[3708]: {"ts": "2026-09-01T10:37:55.885Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1729gitlab # [ 359.149086] gitaly[922]: time="2026-09-01T10:37:55.993Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-01T10:38:25.378" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-01T10:37:55.979" grpc.time_ms=14.199 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1730gitlab # [ 359.190712] gitaly[922]: time="2026-09-01T10:37:56.035Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=9 command.system_time_ms=0 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1V2MWAMRC7F7535RGSH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.019" grpc.time_ms=15.749 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1731gitlab # [ 359.209505] gitaly[922]: time="2026-09-01T10:37:56.046Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 duration_ms=143ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/allowed"1732gitlab # [ 359.213128] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 971733gitlab # [ 359.253213] gitaly[922]: time="2026-09-01T10:37:56.097Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 duration_ms=50ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/pre_receive"1734gitlab # [ 359.259211] gitaly[922]: time="2026-09-01T10:37:56.098Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:55.897" grpc.time_ms=200.625 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1735gitlab # [ 359.312573] gitaly[922]: time="2026-09-01T10:37:56.156Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:56.155" grpc.time_ms=1.044 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1736gitlab # [ 359.336577] gitaly[922]: time="2026-09-01T10:37:56.179Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1Y68JMHGDZV8C6N5DM8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.165" pid=922 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1737gitlab # [ 359.356998] gitlab-workhorse[820]: time="2026-09-01T10:37:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131738gitlab # [ 359.360317] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1421739gitlab # [ 359.364571] gitaly[922]: time="2026-09-01T10:37:56.179Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1Y68JMHGDZV8C6N5DM8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.165" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1740gitlab # [ 359.385880] gitaly[922]: time="2026-09-01T10:37:56.180Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1Y68JMHGDZV8C6N5DM8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.165" grpc.time_ms=14.892 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1741gitlab # [ 359.405426] gitaly[922]: time="2026-09-01T10:37:56.217Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:56.216" grpc.time_ms=0.528 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1742gitlab # [ 359.417964] gitaly[922]: time="2026-09-01T10:37:56.253Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:56.253" grpc.time_ms=0.431 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1743gitlab # [ 359.429134] gitaly[922]: time="2026-09-01T10:37:56.267Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R22SFJRBBQBC9YJV4W24 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.247" pid=922 remote_ip="2001:db8:1::1" request_sha=3a2cb1d969e9cdb560def3873310281563b9593f response_bytes=224 span.kind=server system=grpc1744gitlab # [ 359.441808] gitlab-workhorse[820]: time="2026-09-01T10:37:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241745gitlab # [ 359.445656] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 831746gitlab # [ 359.452485] gitaly[922]: time="2026-09-01T10:37:56.267Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1138 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R22SFJRBBQBC9YJV4W24 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.247" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1747gitlab # [ 359.466016] gitaly[922]: time="2026-09-01T10:37:56.268Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1138 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R22SFJRBBQBC9YJV4W24 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.247" grpc.time_ms=20.76 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1748gitlab # [ 359.526248] gitaly[922]: time="2026-09-01T10:37:56.370Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 duration_ms=78ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/post_receive"1749gitlab # [ 359.532302] gitaly[922]: time="2026-09-01T10:37:56.371Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:56.291" grpc.time_ms=79.828 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1750gitlab # To http://gitlab/root/test-flake.git1751gitlab # [ 359.544366] gitaly[922]: time="2026-09-01T10:37:56.382Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R26PSK953E3A7WJKB6V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.372" grpc.time_ms=9.246 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1752gitlab # df1df45..11ed4f1 [ 359.558395] gitaly[922]: time="2026-09-01T10:37:56.384Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 diskcache=30fde799-6fdf-43ee-bce5-b8292de86687 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:55.817" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1753gitlab # master -> master1754gitlab # [ 359.570673] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 721755gitlab # [ 359.572935] gitlab-workhorse[820]: time="2026-09-01T10:37:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521756gitlab # [ 359.574836] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:56 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6671757gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.06 seconds)1758gitlab # [ 359.577053] gitaly[922]: time="2026-09-01T10:37:56.385Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=201 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13224 command.oublock=32 command.real_time_ms=559 command.spawn_token_fork_ms=4 command.system_time_ms=96 command.user_time_ms=105 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:55.817" grpc.time_ms=567.547 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1759gitlab: must succeed: git -C /tmp/test-flake rev-parse master1760gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1761gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1762gitlab # [ 359.674995] nixbot[3708]: INFO: ::ffff:127.0.0.1:58276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1763gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.08 seconds)1764gitlab # [ 359.818118] gitaly[922]: time="2026-09-01T10:37:56.661Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R2957A96FKJ7SE1ACF00 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.641" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1765gitlab # [ 359.847433] gitaly[922]: time="2026-09-01T10:37:56.661Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R2957A96FKJ7SE1ACF00 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.641" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1766gitlab # [ 359.874018] gitlab-workhorse[820]: time="2026-09-01T10:37:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671767gitlab # [ 359.877135] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2721768gitlab # [ 359.880068] gitaly[922]: time="2026-09-01T10:37:56.661Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R2957A96FKJ7SE1ACF00 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.641" grpc.time_ms=19.726 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1769gitlab # [ 359.968212] gitaly[922]: time="2026-09-01T10:37:56.812Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R2HSK0N23GH49WDW8072 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.778" pid=922 remote_ip="2001:db8:1::1" request_sha=49b809540b9c2df172bb15d543e290e52d7463b0 response_bytes=337 span.kind=server system=grpc1770gitlab # [ 359.999593] gitaly[922]: time="2026-09-01T10:37:56.812Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R2HSK0N23GH49WDW8072 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.778" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1771gitlab # [ 360.032639] gitlab-workhorse[820]: time="2026-09-01T10:37:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371772gitlab # [ 360.035997] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 1481773gitlab # [ 360.039358] gitaly[922]: time="2026-09-01T10:37:56.813Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R2HSK0N23GH49WDW8072 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:56.778" grpc.time_ms=34.299 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1774gitlab # [ 360.182698] gitaly[922]: time="2026-09-01T10:37:57.027Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R2SE2J68M9TKW0NNMHRH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:57.010" grpc.time_ms=16.436 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1775gitlab # [ 360.220420] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1161776gitlab # [ 360.323551] gitaly[922]: time="2026-09-01T10:37:57.167Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R2X7MQ1RXSF8QCQKY6QS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:57.132" pid=922 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1777gitlab # [ 360.355363] gitaly[922]: time="2026-09-01T10:37:57.168Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R2X7MQ1RXSF8QCQKY6QS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:57.132" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1778gitlab # [ 360.386564] gitlab-workhorse[820]: time="2026-09-01T10:37:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091779gitlab # [ 360.389993] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1381780gitlab # [ 360.393465] gitaly[922]: time="2026-09-01T10:37:57.169Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R2X7MQ1RXSF8QCQKY6QS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:37:57.132" grpc.time_ms=35.702 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1781gitlab # [ 360.504420] gitaly[922]: time="2026-09-01T10:37:57.348Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:27.046" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:57.347" grpc.time_ms=1.179 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782gitlab # [ 360.600190] gitaly[922]: time="2026-09-01T10:37:57.444Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-01T10:38:27.125" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:57.425" grpc.time_ms=18.552 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1784gitlab # [ 360.651740] gitaly[922]: time="2026-09-01T10:37:57.496Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:38:07.078" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:57.479" grpc.time_ms=16.64 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 360.691711] gitaly[922]: time="2026-09-01T10:37:57.536Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:38:07.117" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:57.518" grpc.time_ms=17.45 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 360.725044] nixbot[3708]: INFO: ::ffff:127.0.0.1:58292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1787gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1788gitlab # [ 360.868747] gitaly[922]: time="2026-09-01T10:37:57.712Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:38:07.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:57.711" grpc.time_ms=0.698 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 360.903374] gitaly[922]: time="2026-09-01T10:37:57.747Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:38:07.028" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:37:57.728" grpc.time_ms=18.383 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 360.978232] gitaly[922]: time="2026-09-01T10:37:57.822Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:57.821" grpc.time_ms=0.933 pid=922 span.kind=server system=grpc1791gitlab # [ 361.018447] gitaly[922]: time="2026-09-01T10:37:57.862Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:37:57.862" grpc.time_ms=0.65 pid=922 span.kind=server system=grpc1792gitlab # [ 361.046837] gitaly[922]: time="2026-09-01T10:37:57.872Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q diskcache=f96d9183-2bfe-4077-9ffc-1e811980ee11 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:38:07.052" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:57.753" pid=922 ref=refs/keep-around/df1df45dad5c717fe1052bdce23b6d1991c51b6a remote_ip="2001:db8:1::1" revision=df1df45dad5c717fe1052bdce23b6d1991c51b6a span.kind=server system=grpc username=root1793gitlab # [ 361.071372] gitaly[922]: time="2026-09-01T10:37:57.873Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=113 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5110 command.oublock=8 command.real_time_ms=110 command.spawn_token_fork_ms=2 command.system_time_ms=55 command.user_time_ms=58 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:38:07.052" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:37:57.753" grpc.time_ms=120.114 pid=922 ref=refs/keep-around/df1df45dad5c717fe1052bdce23b6d1991c51b6a remote_ip="2001:db8:1::1" revision=df1df45dad5c717fe1052bdce23b6d1991c51b6a span.kind=server system=grpc username=root1794gitlab # [ 361.094244] gitaly[922]: time="2026-09-01T10:37:57.883Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:27.582" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:37:57.882" grpc.time_ms=0.552 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 361.342484] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:37:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 9451796gitlab # [ 361.349916] nixbot[3708]: {"ts": "2026-09-01T10:37:58.187Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a \"HTTP/1.1 201 Created\""}1797gitlab # [ 361.361782] nixbot[3708]: {"ts": "2026-09-01T10:37:58.206Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-df1df45dad5c-0"}1798gitlab # [ 361.662276] nixbot[3708]: {"ts": "2026-09-01T10:37:58.506Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-df1df45dad5c-0", "argv0": "bwrap"}1799gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1800gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.07 seconds)1801gitlab # [ 361.800454] nixbot[3708]: INFO: ::ffff:127.0.0.1:52892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1802gitlab # [ 361.861111] systemd[1]: Started Nix Daemon.1803gitlab # [ 361.977133] nix-daemon[3936]: accepted connection from pid 3928, user nixbot1804gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1805gitlab # [ 362.860372] nixbot[3708]: INFO: ::ffff:127.0.0.1:52904 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1806gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1807gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1808gitlab # [ 363.918979] nixbot[3708]: INFO: ::ffff:127.0.0.1:52908 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1809gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1810gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1811gitlab # [ 364.976708] nixbot[3708]: INFO: ::ffff:127.0.0.1:52910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1812gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1813gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1814gitlab # [ 366.033375] nixbot[3708]: INFO: ::ffff:127.0.0.1:52922 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1815gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1816gitlab # [ 366.691940] nix-daemon[3936]: accepted connection from pid 3959, user nixbot1817gitlab # [ 366.714007] nix-daemon[3936]: accepted connection from pid 3928, user nixbot1818gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1819gitlab # [ 367.092307] nixbot[3708]: INFO: ::ffff:127.0.0.1:52938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1820gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1821gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1822gitlab # [ 368.150249] nixbot[3708]: INFO: ::ffff:127.0.0.1:52948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1823gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1824gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1826gitlab # [ 369.208690] nixbot[3708]: INFO: ::ffff:127.0.0.1:52954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1827gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1828gitlab # [ 370.265282] nixbot[3708]: INFO: ::ffff:127.0.0.1:52964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1829gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1830gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1832gitlab # [ 371.322342] nixbot[3708]: INFO: ::ffff:127.0.0.1:59978 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1833gitlab # [ 371.401998] nix-daemon[3936]: accepted connection from pid 3928, user nixbot1834gitlab # [ 371.611184] gitaly[922]: time="2026-09-01T10:38:08.454Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8RDYG44WKGD7MFQX2EG0A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:38.152" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:38:08.452" grpc.time_ms=1.2 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1835gitlab # [ 371.678674] gitaly[922]: time="2026-09-01T10:38:08.522Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8RDYG44WKGD7MFQX2EG0A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:38:18.102" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:08.503" grpc.time_ms=19.405 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 371.801060] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:38:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3061837gitlab # [ 371.810440] nixbot[3708]: {"ts": "2026-09-01T10:38:08.646Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a \"HTTP/1.1 201 Created\""}1838gitlab # [ 371.897045] gitaly[922]: time="2026-09-01T10:38:08.741Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8RE8DMQ9YE3MQYWS5585S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:38.139" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:38:08.740" grpc.time_ms=0.963 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839gitlab # [ 372.085227] gitaly[922]: time="2026-09-01T10:38:08.929Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8RE8DMQ9YE3MQYWS5585S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:38:18.230" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:08.911" grpc.time_ms=18.106 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840gitlab # [ 372.308794] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:38:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4981841gitlab # [ 372.317108] nixbot[3708]: {"ts": "2026-09-01T10:38:09.154Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a \"HTTP/1.1 201 Created\""}1842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1843gitlab # [ 372.373240] nixbot[3708]: INFO: ::ffff:127.0.0.1:59984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1844gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1845gitlab # [ 372.430200] gitaly[922]: time="2026-09-01T10:38:09.274Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8RERMMRZ6FD92PVT02EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:38:39.072" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:38:09.273" grpc.time_ms=1.168 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 372.486742] gitaly[922]: time="2026-09-01T10:38:09.331Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1E8RERMMRZ6FD92PVT02EVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:38:19.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:38:09.317" grpc.time_ms=13.305 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1847gitlab # [ 372.564822] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:38:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2351848gitlab # [ 372.568930] nixbot[3708]: {"ts": "2026-09-01T10:38:09.411Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a \"HTTP/1.1 201 Created\""}1849gitlab # [ 372.915912] gitaly[922]: time="2026-09-01T10:38:09.759Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8RF6X19J4A7G0QQ7GTRQ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:38:09.740" grpc.time_ms=18.609 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1850gitlab # [ 372.955404] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:38:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1301851gitlab # [ 373.056223] gitaly[922]: time="2026-09-01T10:38:09.900Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8RFB27TC3BKBCCXMD1GTX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:38:09.880" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1852gitlab # [ 373.080821] gitaly[922]: time="2026-09-01T10:38:09.900Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8RFB27TC3BKBCCXMD1GTX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:38:09.880" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1853gitlab # [ 373.108649] gitlab-workhorse[820]: time="2026-09-01T10:38:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671854gitlab # [ 373.114606] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:38:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1391855gitlab # [ 373.120797] gitaly[922]: time="2026-09-01T10:38:09.901Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8RFB27TC3BKBCCXMD1GTX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:38:09.880" grpc.time_ms=20.961 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc1856gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1857gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.08 seconds)1858gitlab # [ 373.457124] nixbot[3708]: INFO: ::ffff:127.0.0.1:59994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1859gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1860gitlab # [ 374.514158] nixbot[3708]: INFO: ::ffff:127.0.0.1:59998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1861gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1862gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1863gitlab # [ 375.570947] nixbot[3708]: INFO: ::ffff:127.0.0.1:60014 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1865gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1866gitlab # [ 376.627116] nixbot[3708]: INFO: ::ffff:127.0.0.1:60030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1867gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1868gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1869gitlab # [ 377.684460] nixbot[3708]: INFO: ::ffff:127.0.0.1:60040 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1871gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1872gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1873gitlab # [ 378.741898] nixbot[3708]: INFO: ::ffff:127.0.0.1:60052 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1874gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1875gitlab # [ 379.795598] nixbot[3708]: INFO: ::ffff:127.0.0.1:60064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1876gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1879gitlab # [ 380.853512] nixbot[3708]: INFO: ::ffff:127.0.0.1:49960 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1880gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1881gitlab # [ 381.908164] nixbot[3708]: INFO: ::ffff:127.0.0.1:49972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1882gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1883gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1884gitlab # [ 382.965442] nixbot[3708]: INFO: ::ffff:127.0.0.1:49984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1885gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1886gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1887gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1888gitlab # [ 384.021665] nixbot[3708]: INFO: ::ffff:127.0.0.1:49988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1889gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1890gitlab # [ 385.076250] nixbot[3708]: INFO: ::ffff:127.0.0.1:50004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1892gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1893gitlab # [ 386.131882] nixbot[3708]: INFO: ::ffff:127.0.0.1:50006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1894gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1895gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1896gitlab # [ 387.189347] nixbot[3708]: INFO: ::ffff:127.0.0.1:50008 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1897gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1898gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1899gitlab # [ 388.246736] nixbot[3708]: INFO: ::ffff:127.0.0.1:50014 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1900gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1901gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1902gitlab # [ 389.304562] nixbot[3708]: INFO: ::ffff:127.0.0.1:50022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1903gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1904gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1905gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1906gitlab # [ 390.361007] nixbot[3708]: INFO: ::ffff:127.0.0.1:50024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1907gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1908gitlab # [ 391.415527] nixbot[3708]: INFO: ::ffff:127.0.0.1:59824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1909gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1910gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1911gitlab # [ 392.471559] nixbot[3708]: INFO: ::ffff:127.0.0.1:59826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1912gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1913gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1915gitlab # [ 393.530295] nixbot[3708]: INFO: ::ffff:127.0.0.1:59842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1916gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1917gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1918gitlab # [ 394.584240] nixbot[3708]: INFO: ::ffff:127.0.0.1:59852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1919gitlab # [ 395.478845] sidekiq-cluster[3646]: 2026-09-01T10:38:32.321Z pid=3646 tid=y3a INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3646, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430583808}1920gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1921gitlab # [ 395.638234] nixbot[3708]: INFO: ::ffff:127.0.0.1:59860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1922gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1923gitlab # [ 395.770380] sidekiq-cluster[3646]: W, [2026-09-01T10:38:32.614598 #3646] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1924gitlab # [ 395.835991] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:38:32.680Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1925gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1926gitlab # [ 396.695048] nixbot[3708]: INFO: ::ffff:127.0.0.1:59874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1927gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1928gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1929gitlab # [ 397.752460] nixbot[3708]: INFO: ::ffff:127.0.0.1:59884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1931gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1932gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1933gitlab # [ 398.809683] nixbot[3708]: INFO: ::ffff:127.0.0.1:59890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1934gitlab # [ 399.474450] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:38:36.317Z","message":"GitLab reliable fetch activated!"}1935gitlab # [ 399.474934] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:38:36.317Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1936gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1937gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1938gitlab # [ 399.864077] nixbot[3708]: INFO: ::ffff:127.0.0.1:59898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1939gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1940gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1941gitlab # [ 400.918636] nixbot[3708]: INFO: ::ffff:127.0.0.1:51604 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1942gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1944gitlab # [ 401.972169] nixbot[3708]: INFO: ::ffff:127.0.0.1:51618 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1945gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1947gitlab # [ 403.025912] nixbot[3708]: INFO: ::ffff:127.0.0.1:51620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1948gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1949gitlab # [ 404.079687] nixbot[3708]: INFO: ::ffff:127.0.0.1:51626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1950gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1951gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1952gitlab # [ 405.135959] nixbot[3708]: INFO: ::ffff:127.0.0.1:51636 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1955gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1956gitlab # [ 406.199855] nixbot[3708]: INFO: ::ffff:127.0.0.1:51652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1959gitlab # [ 407.254554] nixbot[3708]: INFO: ::ffff:127.0.0.1:51662 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1961gitlab # [ 408.308631] nixbot[3708]: INFO: ::ffff:127.0.0.1:51664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1965gitlab # [ 409.363786] nixbot[3708]: INFO: ::ffff:127.0.0.1:51680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1967gitlab # [ 410.419011] nixbot[3708]: INFO: ::ffff:127.0.0.1:51684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1970gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1971gitlab # [ 411.475224] nixbot[3708]: INFO: ::ffff:127.0.0.1:54224 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1974gitlab # [ 412.530024] nixbot[3708]: INFO: ::ffff:127.0.0.1:54240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1976gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1977gitlab # [ 413.584202] nixbot[3708]: INFO: ::ffff:127.0.0.1:54254 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1978gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1980gitlab # [ 414.638208] nixbot[3708]: INFO: ::ffff:127.0.0.1:54264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1981gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1982gitlab # [ 415.693236] nixbot[3708]: INFO: ::ffff:127.0.0.1:54272 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1983gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1984gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1985gitlab # [ 416.750358] nixbot[3708]: INFO: ::ffff:127.0.0.1:54288 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1986gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1987gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1988gitlab # [ 417.808449] nixbot[3708]: INFO: ::ffff:127.0.0.1:54292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1989gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1990gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)1992gitlab # [ 418.865367] nixbot[3708]: INFO: ::ffff:127.0.0.1:54294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1993gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1994gitlab # [ 419.920233] nixbot[3708]: INFO: ::ffff:127.0.0.1:54302 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1995gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1996gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'1997gitlab # [ 420.977642] nixbot[3708]: INFO: ::ffff:127.0.0.1:50718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK1998gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)1999gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)2001gitlab # [ 422.035589] nixbot[3708]: INFO: ::ffff:127.0.0.1:50726 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2003gitlab # [ 423.090220] nixbot[3708]: INFO: ::ffff:127.0.0.1:50736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2006gitlab # [ 424.148327] nixbot[3708]: INFO: ::ffff:127.0.0.1:50752 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2008gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2009gitlab # [ 425.203959] nixbot[3708]: INFO: ::ffff:127.0.0.1:50756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2011gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2012gitlab # [ 426.260483] nixbot[3708]: INFO: ::ffff:127.0.0.1:50766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2014gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2015gitlab # [ 427.318334] nixbot[3708]: INFO: ::ffff:127.0.0.1:50772 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2016gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2017gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2018gitlab # [ 428.375246] nixbot[3708]: INFO: ::ffff:127.0.0.1:50780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2019gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2020gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2021gitlab # [ 429.432894] nixbot[3708]: INFO: ::ffff:127.0.0.1:50782 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2022gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2023gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)2025gitlab # [ 430.489681] nixbot[3708]: INFO: ::ffff:127.0.0.1:50784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2026gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2027gitlab # [ 431.543164] nixbot[3708]: INFO: ::ffff:127.0.0.1:38848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2029gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2030gitlab # [ 432.599030] nixbot[3708]: INFO: ::ffff:127.0.0.1:38854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2031gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)2032gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2033gitlab # [ 433.653949] nixbot[3708]: INFO: ::ffff:127.0.0.1:38862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2034gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2035gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2036gitlab # [ 434.711202] nixbot[3708]: INFO: ::ffff:127.0.0.1:38864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2038gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2039gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)2040gitlab # [ 435.766694] nixbot[3708]: INFO: ::ffff:127.0.0.1:38880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2041gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)2043gitlab # [ 436.820626] nixbot[3708]: INFO: ::ffff:127.0.0.1:38882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2044gitlab # [ 437.201251] postgres[4234]: [4234] ERROR: relation "table_without_models" does not exist2045gitlab # [ 437.204787] postgres[4234]: [4234] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2046gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2047gitlab # [ 437.875345] nixbot[3708]: INFO: ::ffff:127.0.0.1:38890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2048gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2049gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2050gitlab # [ 438.932291] nixbot[3708]: INFO: ::ffff:127.0.0.1:38900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2051gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2052gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2053gitlab # [ 439.995777] nixbot[3708]: INFO: ::ffff:127.0.0.1:38914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2054gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2055gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2056gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.07 seconds)2057gitlab # [ 441.063610] nixbot[3708]: INFO: ::ffff:127.0.0.1:49680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2058gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2059gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2060gitlab # [ 442.123182] nixbot[3708]: INFO: ::ffff:127.0.0.1:49682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2061gitlab # [ 442.481675] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:19.324Z","message":"Booted Rails 7.2.3.1 application in production environment"}2062gitlab # [ 442.487800] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:19.328Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2063gitlab # [ 442.495071] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:19.328Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2064gitlab # [ 442.500495] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:19.328Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2065gitlab # [ 442.506513] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:19.330Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2066gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2067gitlab # [ 443.188536] nixbot[3708]: INFO: ::ffff:127.0.0.1:49694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2068gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.07 seconds)2069gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2070gitlab # [ 444.254415] nixbot[3708]: INFO: ::ffff:127.0.0.1:49708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2071gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2072gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2073gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.08 seconds)2074gitlab # [ 445.336967] nixbot[3708]: INFO: ::ffff:127.0.0.1:49712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2075gitlab # [ 445.339585] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:22.182Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bbef93ffeb189dd3ea335e5a","created_at":"2026-09-01T10:37:47.163Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:47.211Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bbef93ffeb189dd3ea335e5a: start","job_status":"start","queue_duration_s":94.971085,"scheduling_latency_s":94.971186}2076gitlab # [ 445.594190] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:22.437Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"bbef93ffeb189dd3ea335e5a","created_at":"2026-09-01T10:37:47.163Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:47.211Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-bbef93ffeb189dd3ea335e5a: done: 0.255423 sec","job_status":"done","queue_duration_s":94.971085,"scheduling_latency_s":94.971186,"redis_calls":23,"redis_duration_s":0.008008,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004299,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002092,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001617,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.110899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14209516,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.255423,"completed_at":"2026-09-01T10:39:22.437Z","load_balancing_strategy":"primary","db_duration_s":0.096701,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2077gitlab # [ 445.705200] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:22.440Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"c2bc352cb7c1dec839bbf80d","created_at":"2026-09-01T10:37:47.228Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:47.236Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-c2bc352cb7c1dec839bbf80d: start","job_status":"start","queue_duration_s":95.203968,"scheduling_latency_s":95.203999}2078gitlab # [ 445.749536] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:22.593Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"c2bc352cb7c1dec839bbf80d","created_at":"2026-09-01T10:37:47.228Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:47.236Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-c2bc352cb7c1dec839bbf80d: done: 0.152332 sec","job_status":"done","queue_duration_s":95.203968,"scheduling_latency_s":95.203999,"redis_calls":14,"redis_duration_s":0.004889,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001003,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00235,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001536,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.111044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11618526,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.152332,"completed_at":"2026-09-01T10:39:22.593Z","load_balancing_strategy":"primary","db_duration_s":0.031308,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2079gitlab # [ 445.834369] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:22.595Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8a9f4acc4342c3be4c05882e","created_at":"2026-09-01T10:37:47.990Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:48.000Z","job_size_bytes":5,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8a9f4acc4342c3be4c05882e: start","job_status":"start","queue_duration_s":94.595275,"scheduling_latency_s":94.5953}2080gitlab # [ 446.027532] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:22.871Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8a9f4acc4342c3be4c05882e","created_at":"2026-09-01T10:37:47.990Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:48.000Z","job_size_bytes":5,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8a9f4acc4342c3be4c05882e: done: 0.275601 sec","job_status":"done","queue_duration_s":94.595275,"scheduling_latency_s":94.5953,"redis_calls":12,"redis_duration_s":0.003835,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000853,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002384,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.225595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051854,"duration_s":0.275601,"completed_at":"2026-09-01T10:39:22.871Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042528,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2081gitlab # [ 446.127426] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:22.873Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"b2de3fa4174cce391160ccdf","created_at":"2026-09-01T10:37:48.036Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:48.042Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-b2de3fa4174cce391160ccdf: start","job_status":"start","queue_duration_s":94.83068,"scheduling_latency_s":94.830704}2082gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2083gitlab # [ 446.398223] nixbot[3708]: INFO: ::ffff:127.0.0.1:49726 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2084gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2085gitlab # [ 446.405558] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:23.246Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"b2de3fa4174cce391160ccdf","created_at":"2026-09-01T10:37:48.036Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:48.042Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-b2de3fa4174cce391160ccdf: done: 0.373262 sec","job_status":"done","queue_duration_s":94.83068,"scheduling_latency_s":94.830704,"redis_calls":11,"redis_duration_s":0.004205,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000843,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002524,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000838,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.316,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.316,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.255246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0012666,"duration_s":0.373262,"completed_at":"2026-09-01T10:39:23.246Z","load_balancing_strategy":"primary","db_duration_s":0.122581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2086gitlab # [ 446.491805] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:23.251Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"faa49e537121be3982cf5da2","created_at":"2026-09-01T10:37:48.046Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:48.052Z","job_size_bytes":89,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-faa49e537121be3982cf5da2: start","job_status":"start","queue_duration_s":95.198978,"scheduling_latency_s":95.19903}2087gitlab # [ 446.511512] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:23.335Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"faa49e537121be3982cf5da2","created_at":"2026-09-01T10:37:48.046Z","trace_propagation_headers":{"sentry-trace":"ca1c9b3ed90848d7927f932911cf8518-10dacd8b472941e8","baggage":"sentry-trace_id=ca1c9b3ed90848d7927f932911cf8518,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QQNEHE80XN13TN8R5Q4H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:48.052Z","job_size_bytes":89,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-faa49e537121be3982cf5da2: done: 0.083363 sec","job_status":"done","queue_duration_s":95.198978,"scheduling_latency_s":95.19903,"redis_calls":11,"redis_duration_s":0.004403000000000001,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00119,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002367,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066798,"duration_s":0.083363,"completed_at":"2026-09-01T10:39:23.334Z","load_balancing_strategy":"primary","db_duration_s":0.010603,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2088gitlab # [ 446.557239] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:23.337Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 df1df45dad5c717fe1052bdce23b6d1991c51b6a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4a0079ff65fcba5a278cc441","created_at":"2026-09-01T10:37:51.307Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-e3dba649746e4ae3","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:51.350Z","job_size_bytes":185,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4a0079ff65fcba5a278cc441: start","job_status":"start","queue_duration_s":91.987271,"scheduling_latency_s":91.9873}2089gitlab # [ 446.574193] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:23.364Z","message":"changes: \"0000000000000000000000000000000000000000 df1df45dad5c717fe1052bdce23b6d1991c51b6a refs/heads/master\\n\""}2090gitlab # [ 446.583628] gitaly[922]: time="2026-09-01T10:39:23.427Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:33.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:23.409" grpc.time_ms=17.908 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 446.609021] gitaly[922]: time="2026-09-01T10:39:23.453Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:39:33.037" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:23.438" grpc.time_ms=15.122 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab # [ 446.705800] gitaly[922]: time="2026-09-01T10:39:23.550Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-01T10:39:33.128" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:23.528" grpc.time_ms=21.054 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 446.786970] gitaly[922]: time="2026-09-01T10:39:23.631Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:23.630" grpc.time_ms=0.758 pid=922 span.kind=server system=grpc2094gitlab # [ 446.838158] gitaly[922]: time="2026-09-01T10:39:23.682Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:23.681" grpc.time_ms=0.708 pid=922 span.kind=server system=grpc2095gitlab # [ 446.867590] gitaly[922]: time="2026-09-01T10:39:23.696Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E diskcache=f862e49d-093a-4213-86c5-77dafa28ef7e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:39:33.169" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:23.569" pid=922 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2096gitlab # [ 446.891317] gitaly[922]: time="2026-09-01T10:39:23.697Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=142 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5289 command.oublock=8 command.real_time_ms=120 command.spawn_token_fork_ms=1 command.system_time_ms=90 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:39:33.169" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:23.569" grpc.time_ms=127.374 pid=922 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2097gitlab # [ 446.916557] gitaly[922]: time="2026-09-01T10:39:23.726Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-01T10:39:33.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:23.726" grpc.time_ms=0.375 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 446.934368] gitaly[922]: time="2026-09-01T10:39:23.759Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=858 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-01T10:39:33.013" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:23.733" grpc.time_ms=24.818 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 447.100336] gitaly[922]: time="2026-09-01T10:39:23.944Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-01T10:39:53.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:23.932" grpc.time_ms=12.133 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 447.160524] gitaly[922]: time="2026-09-01T10:39:24.004Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:39:34.003" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:24.004" grpc.time_ms=0.637 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 447.190718] gitaly[922]: time="2026-09-01T10:39:24.020Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-01T10:39:34.008" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-01T10:39:24.008" grpc.time_ms=11.291 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 447.221593] gitaly[922]: time="2026-09-01T10:39:24.065Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:34.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:24.048" grpc.time_ms=17.363 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 447.250318] gitaly[922]: time="2026-09-01T10:39:24.094Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:34.077" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:24.077" grpc.time_ms=16.637 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 447.298992] gitaly[922]: time="2026-09-01T10:39:24.143Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=883 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=11 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-01T10:39:54.014" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:24.115" grpc.time_ms=28.106 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2106gitlab # [ 447.465967] nixbot[3708]: INFO: ::ffff:127.0.0.1:49738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2107gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.07 seconds)2108gitlab # [ 447.967981] gitaly[922]: time="2026-09-01T10:39:24.811Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-01T10:39:34.088" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:24.808" grpc.time_ms=2.301 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 448.006607] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:24.849Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 df1df45dad5c717fe1052bdce23b6d1991c51b6a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4a0079ff65fcba5a278cc441","created_at":"2026-09-01T10:37:51.307Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-e3dba649746e4ae3","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:51.350Z","job_size_bytes":185,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4a0079ff65fcba5a278cc441: done: 1.511783 sec","job_status":"done","queue_duration_s":91.987271,"scheduling_latency_s":91.9873,"gitaly_calls":13,"gitaly_duration_s":0.352696,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.067966,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.007929,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009113,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002427,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005297,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.028865,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.014335,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.089,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.314,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.365,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.089,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.010757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00118056,"exclusive_lock_hold_duration_s":0.04664986,"duration_s":1.511783,"completed_at":"2026-09-01T10:39:24.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.160244,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2110gitlab # [ 448.098931] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:24.852Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","df1df45dad5c717fe1052bdce23b6d1991c51b6a 11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"92a024b472def7415301dd84","created_at":"2026-09-01T10:37:56.343Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-3254bbf4de5c403e","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:56.348Z","job_size_bytes":185,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-92a024b472def7415301dd84: start","job_status":"start","queue_duration_s":88.503958,"scheduling_latency_s":88.503985}2111gitlab # [ 448.117140] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:24.867Z","message":"changes: \"df1df45dad5c717fe1052bdce23b6d1991c51b6a 11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 refs/heads/master\\n\""}2112gitlab # [ 448.119505] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:24.936Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"458482f22e7f0971548c06ad","created_at":"2026-09-01T10:39:24.933Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-c8c93c7547ac4808","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"b1e5563ff34f0605fd7dca41","job_size_bytes":46,"pid":3646,"job_status":"deduplicated","message":"ProjectCacheWorker JID-458482f22e7f0971548c06ad: deduplicated: until executing","deduplication.type":"until executing"}2113gitlab # [ 448.134450] gitaly[922]: time="2026-09-01T10:39:24.904Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:34.167" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:24.887" grpc.time_ms=16.279 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 448.147335] gitaly[922]: time="2026-09-01T10:39:24.928Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-01T10:39:34.192" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:24.912" grpc.time_ms=15.436 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 448.160910] gitaly[922]: time="2026-09-01T10:39:24.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-01T10:39:34.241" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:24.962" grpc.time_ms=16.91 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 448.174128] gitaly[922]: time="2026-09-01T10:39:25.007Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-01T10:39:54.087" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:24.987" grpc.time_ms=19.371 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 448.193044] gitaly[922]: time="2026-09-01T10:39:25.037Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-01T10:39:35.026" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-01T10:39:25.026" grpc.time_ms=10.573 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 448.226542] gitaly[922]: time="2026-09-01T10:39:25.070Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:35.054" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:25.054" grpc.time_ms=16.485 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2120gitlab # [ 448.527515] nixbot[3708]: INFO: ::ffff:127.0.0.1:49742 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2121gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.06 seconds)2122gitlab # [ 448.529801] gitaly[922]: time="2026-09-01T10:39:25.373Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-01T10:39:35.231" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:25.231" grpc.time_ms=141.369 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 448.576812] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:25.419Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","df1df45dad5c717fe1052bdce23b6d1991c51b6a 11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"92a024b472def7415301dd84","created_at":"2026-09-01T10:37:56.343Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-3254bbf4de5c403e","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:37:56.348Z","job_size_bytes":185,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-92a024b472def7415301dd84: done: 0.56775 sec","job_status":"done","queue_duration_s":88.503958,"scheduling_latency_s":88.503985,"gitaly_calls":7,"gitaly_duration_s":0.26404,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.033561,"redis_read_bytes":500,"redis_write_bytes":11939,"redis_cache_calls":9,"redis_cache_duration_s":0.004153,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001638,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5716,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004984,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010073,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012713,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.042,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.042,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.395732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00072964,"exclusive_lock_hold_duration_s":0.02791152,"duration_s":0.56775,"completed_at":"2026-09-01T10:39:25.419Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041282,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2124gitlab # [ 448.645049] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:25.423Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"f97e51484e33cdd93538c026","created_at":"2026-09-01T10:37:57.900Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-db6c77397ce34199","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:57.912Z","job_size_bytes":65,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-f97e51484e33cdd93538c026: start","job_status":"start","queue_duration_s":87.510518,"scheduling_latency_s":87.510563}2125gitlab # [ 448.739124] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:25.582Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"f97e51484e33cdd93538c026","created_at":"2026-09-01T10:37:57.900Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-db6c77397ce34199","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:57.912Z","job_size_bytes":65,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-f97e51484e33cdd93538c026: done: 0.158732 sec","job_status":"done","queue_duration_s":87.510518,"scheduling_latency_s":87.510563,"redis_calls":16,"redis_duration_s":0.006306,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003363,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002207,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068344,"duration_s":0.158732,"completed_at":"2026-09-01T10:39:25.581Z","load_balancing_strategy":"primary","db_duration_s":0.039673,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2126gitlab # [ 448.819617] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:25.585Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c036ae25bc6714328bb70b97","created_at":"2026-09-01T10:37:57.914Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-db6c77397ce34199","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:57.925Z","job_size_bytes":65,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c036ae25bc6714328bb70b97: start","job_status":"start","queue_duration_s":87.659652,"scheduling_latency_s":87.659681}2127gitlab # [ 448.952792] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:25.796Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c036ae25bc6714328bb70b97","created_at":"2026-09-01T10:37:57.914Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-db6c77397ce34199","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:57.925Z","job_size_bytes":65,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c036ae25bc6714328bb70b97: done: 0.210798 sec","job_status":"done","queue_duration_s":87.659652,"scheduling_latency_s":87.659681,"redis_calls":21,"redis_duration_s":0.008675,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003314,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002501,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00286,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.140962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00101354,"duration_s":0.210798,"completed_at":"2026-09-01T10:39:25.795Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2128gitlab # [ 449.049057] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:25.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"aa0707f80b6df1f0603fcd27","created_at":"2026-09-01T10:37:58.125Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-db6c77397ce34199","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:58.140Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-aa0707f80b6df1f0603fcd27: start","job_status":"start","queue_duration_s":87.658865,"scheduling_latency_s":87.658908}2129gitlab # [ 449.289477] gitaly[922]: time="2026-09-01T10:39:26.132Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:26.131" grpc.time_ms=0.794 pid=922 span.kind=server system=grpc2130gitlab # [ 449.346703] gitaly[922]: time="2026-09-01T10:39:26.191Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:26.189" grpc.time_ms=1.084 pid=922 span.kind=server system=grpc2131gitlab # [ 449.402225] gitaly[922]: time="2026-09-01T10:39:26.246Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:26.244" grpc.time_ms=1.888 pid=922 span.kind=server system=grpc2132gitlab # [ 449.431667] gitaly[922]: time="2026-09-01T10:39:26.262Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q diskcache=fc10056f-18ed-4bfa-bf20-114f66d0a406 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:56.069" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:26.070" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 449.456593] gitaly[922]: time="2026-09-01T10:39:26.262Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=215 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7561 command.oublock=0 command.real_time_ms=184 command.spawn_token_fork_ms=1 command.system_time_ms=150 command.user_time_ms=65 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:39:56.069" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:26.070" grpc.time_ms=191.844 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2135gitlab # [ 449.593259] nixbot[3708]: INFO: ::ffff:127.0.0.1:49758 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2136gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.07 seconds)2137gitlab # [ 449.659383] gitaly[922]: time="2026-09-01T10:39:26.503Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:39:56.501" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:26.501" grpc.time_ms=1.806 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 449.746956] gitaly[922]: time="2026-09-01T10:39:26.591Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R33QEZNV7H3NV767CF4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:56.588" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:26.589" grpc.time_ms=1.548 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 449.791241] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:26.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"aa0707f80b6df1f0603fcd27","created_at":"2026-09-01T10:37:58.125Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-db6c77397ce34199","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:37:58.140Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-aa0707f80b6df1f0603fcd27: done: 0.835024 sec","job_status":"done","queue_duration_s":87.658865,"scheduling_latency_s":87.658908,"gitaly_calls":3,"gitaly_duration_s":0.208101,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.045382,"redis_read_bytes":457,"redis_write_bytes":27997,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002178,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002438,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.016666,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006614,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14491,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009892,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001099,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000839,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003478,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.105,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.042,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.047,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.054,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.490154,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.70516056,"duration_s":0.835024,"completed_at":"2026-09-01T10:39:26.634Z","load_balancing_strategy":"primary","db_duration_s":0.124359,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2140gitlab # [ 449.876125] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:26.637Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b1e5563ff34f0605fd7dca41","created_at":"2026-09-01T10:39:23.457Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:23.486Z","job_size_bytes":46,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b1e5563ff34f0605fd7dca41: start","job_status":"start","queue_duration_s":3.151069,"scheduling_latency_s":3.151108}2141gitlab # [ 449.895568] gitaly[922]: time="2026-09-01T10:39:26.730Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-01T16:39:26.718" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:26.719" grpc.time_ms=10.775 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 449.917405] gitaly[922]: time="2026-09-01T10:39:26.761Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-01T10:39:56.743" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:26.744" grpc.time_ms=17.515 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 449.977424] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:26.820Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b1e5563ff34f0605fd7dca41","created_at":"2026-09-01T10:39:23.457Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:23.486Z","job_size_bytes":46,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b1e5563ff34f0605fd7dca41: done: 0.183179 sec","job_status":"done","queue_duration_s":3.151069,"scheduling_latency_s":3.151108,"gitaly_calls":2,"gitaly_duration_s":0.035188,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011496,"redis_read_bytes":69,"redis_write_bytes":4882,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002444,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001203,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002726,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004062,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072504,"duration_s":0.183179,"completed_at":"2026-09-01T10:39:26.820Z","load_balancing_strategy":"primary","db_duration_s":0.019383,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2144gitlab # [ 450.054337] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:26.823Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"37295f8c6a0844f93caa26a8","created_at":"2026-09-01T10:39:23.513Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:23.522Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-37295f8c6a0844f93caa26a8: start","job_status":"start","queue_duration_s":3.301596,"scheduling_latency_s":3.301633}2145gitlab # [ 450.074572] gitaly[922]: time="2026-09-01T10:39:26.902Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E diskcache=b0dc1f7b-7d3e-441f-a89a-4d212ae142b5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:39:26.865" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:26.865" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 450.088554] gitaly[922]: time="2026-09-01T10:39:26.903Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=45 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:39:26.865" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:26.865" grpc.time_ms=37.198 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 450.126062] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:26.969Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"37295f8c6a0844f93caa26a8","created_at":"2026-09-01T10:39:23.513Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:23.522Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-37295f8c6a0844f93caa26a8: done: 0.146073 sec","job_status":"done","queue_duration_s":3.301596,"scheduling_latency_s":3.301633,"gitaly_calls":1,"gitaly_duration_s":0.041039,"redis_calls":15,"redis_duration_s":0.005698,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000703,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002042,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001145,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.035,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10486202,"duration_s":0.146073,"completed_at":"2026-09-01T10:39:26.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025219,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2148gitlab # [ 450.182065] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:26.972Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"89128f3f4484bb81da79c8c1","created_at":"2026-09-01T10:39:23.718Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:23.721Z","job_size_bytes":23,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-89128f3f4484bb81da79c8c1: start","job_status":"start","queue_duration_s":3.250845,"scheduling_latency_s":3.250877}2149gitlab # [ 450.197294] gitaly[922]: time="2026-09-01T10:39:27.034Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-01T10:39:57.017" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:27.017" grpc.time_ms=16.927 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 450.209869] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:27.048Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"89128f3f4484bb81da79c8c1","created_at":"2026-09-01T10:39:23.718Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:23.721Z","job_size_bytes":23,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-89128f3f4484bb81da79c8c1: done: 0.075841 sec","job_status":"done","queue_duration_s":3.250845,"scheduling_latency_s":3.250877,"gitaly_calls":1,"gitaly_duration_s":0.019876,"redis_calls":16,"redis_duration_s":0.006121,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000433,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002041,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002621,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075841,"completed_at":"2026-09-01T10:39:27.048Z","load_balancing_strategy":"primary","db_duration_s":0.004929,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2151gitlab # [ 450.253320] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:27.050Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"57cdce06392c3acb65bf4a8d","created_at":"2026-09-01T10:39:24.534Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a8f21310f62690956ac613864b713784600fe2dae82f44aab699ae9973a2be4c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:24.546Z","job_size_bytes":467,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-57cdce06392c3acb65bf4a8d: start","job_status":"start","queue_duration_s":2.503676,"scheduling_latency_s":2.503703}2152gitlab # [ 450.270058] gitaly[922]: time="2026-09-01T10:39:27.086Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:57.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:27.085" grpc.time_ms=0.914 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 450.282989] gitaly[922]: time="2026-09-01T10:39:27.103Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:39:37.089" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:27.089" grpc.time_ms=13.625 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 450.428958] gitaly[922]: time="2026-09-01T10:39:27.272Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:39:57.270" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:27.270" grpc.time_ms=1.272 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 450.465845] gitaly[922]: time="2026-09-01T10:39:27.280Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=28 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-01T10:39:57.276" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:27.276" grpc.time_ms=3.637 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2157gitlab # [ 450.610459] gitaly[922]: time="2026-09-01T10:39:27.454Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:37.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:27.438" grpc.time_ms=16.275 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.10 seconds)2159gitlab # [ 450.696933] nixbot[3708]: INFO: ::ffff:127.0.0.1:49774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2160gitlab # [ 451.294435] gitaly[922]: time="2026-09-01T10:39:28.138Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-01T10:39:58.110" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:28.110" grpc.time_ms=27.645 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 451.339531] gitaly[922]: time="2026-09-01T10:39:28.169Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8QWABT18F7BR2MHWWHN4E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-01T10:39:58.142" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:28.142" grpc.time_ms=26.755 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 451.367201] sidekiq-cluster[3646]: {"severity":"WARN","time":"2026-09-01T10:39:28.210Z","class":"CreatePipelineWorker","correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"df1df45dad5c717fe1052bdce23b6d1991c51b6a","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"df1df45dad5c717fe1052bdce23b6d1991c51b6a","ref":"refs/heads/master"},"retry":0}2163gitlab # [ 451.378581] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:28.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"57cdce06392c3acb65bf4a8d","created_at":"2026-09-01T10:39:24.534Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a8f21310f62690956ac613864b713784600fe2dae82f44aab699ae9973a2be4c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:24.546Z","job_size_bytes":467,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-57cdce06392c3acb65bf4a8d: done: 1.17071 sec","job_status":"done","queue_duration_s":2.503676,"scheduling_latency_s":2.503703,"gitaly_calls":7,"gitaly_duration_s":0.111392,"redis_calls":51,"redis_duration_s":0.014884,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001382,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006049,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004022,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.983811,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046608,"duration_s":1.17071,"completed_at":"2026-09-01T10:39:28.220Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.079978,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2164gitlab # [ 451.434898] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:28.223Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"483c5042-eeff-432c-a5e5-9e386572d232\"}"],"class":"WebHookWorker","jid":"4e85466d32f6bff9b2cdab80","created_at":"2026-09-01T10:39:24.770Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:280ee94f9c625331f6f1fb74b30fd8d9290ed4d6083693b950f0afde78166cb9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:24.776Z","job_size_bytes":1751,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-4e85466d32f6bff9b2cdab80: start","job_status":"start","queue_duration_s":3.447419,"scheduling_latency_s":3.447447}2165gitlab # [ 451.561211] nixbot[3708]: INFO: ::ffff:127.0.0.1:36592 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2166gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2167gitlab # [ 451.600100] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:28.443Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"483c5042-eeff-432c-a5e5-9e386572d232\"}"],"class":"WebHookWorker","jid":"4e85466d32f6bff9b2cdab80","created_at":"2026-09-01T10:39:24.770Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-7fee31230a924d59","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:280ee94f9c625331f6f1fb74b30fd8d9290ed4d6083693b950f0afde78166cb9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:24.776Z","job_size_bytes":1751,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-4e85466d32f6bff9b2cdab80: done: 0.219734 sec","job_status":"done","queue_duration_s":3.447419,"scheduling_latency_s":3.447447,"redis_calls":19,"redis_duration_s":0.006233,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001655,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000582,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002604,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08764791999999488,"cpu_s":0.109608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000748,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.219734,"completed_at":"2026-09-01T10:39:28.443Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2168gitlab # [ 451.712615] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:28.446Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0599109c1c356350701b90d5","created_at":"2026-09-01T10:39:24.949Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-c8c93c7547ac4808","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"37295f8c6a0844f93caa26a8","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:24.954Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0599109c1c356350701b90d5: start","job_status":"start","queue_duration_s":3.492549,"scheduling_latency_s":3.492589}2169gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.05 seconds)2170gitlab # [ 451.741902] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:28.528Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0599109c1c356350701b90d5","created_at":"2026-09-01T10:39:24.949Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-c8c93c7547ac4808","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"37295f8c6a0844f93caa26a8","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:24.954Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0599109c1c356350701b90d5: done: 0.081684 sec","job_status":"done","queue_duration_s":3.492549,"scheduling_latency_s":3.492589,"gitaly_calls":1,"gitaly_duration_s":0.018704,"redis_calls":12,"redis_duration_s":0.004843,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001139,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04554972,"duration_s":0.081684,"completed_at":"2026-09-01T10:39:28.528Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009439,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2171gitlab # [ 451.801955] gitaly[922]: time="2026-09-01T10:39:28.498Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 diskcache=af672042-22d6-4e40-8b51-f00b89a4e8d7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:39:28.483" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:28.484" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 451.812094] gitaly[922]: time="2026-09-01T10:39:28.499Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-01T16:39:28.483" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:28.484" grpc.time_ms=15.036 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 451.824674] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:28.530Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3f17ac6fb6a898eb418b907d","created_at":"2026-09-01T10:39:25.169Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-c8c93c7547ac4808","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b3b9e3ff8d87e0b00c467ec565b0dfe1c12349aa05763b0cdc1869eeb977869c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:25.174Z","job_size_bytes":467,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3f17ac6fb6a898eb418b907d: start","job_status":"start","queue_duration_s":3.356914,"scheduling_latency_s":3.356944}2174gitlab # [ 451.842297] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1732175gitlab # [ 451.844705] nixbot[3708]: INFO: ::ffff:127.0.0.1:36606 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2176gitlab # [ 451.846615] gitaly[922]: time="2026-09-01T10:39:28.573Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:58.570" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:28.571" grpc.time_ms=1.933 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 451.858555] gitaly[922]: time="2026-09-01T10:39:28.595Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=9 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:39:38.146" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:28.576" grpc.time_ms=18.731 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 451.871391] gitaly[922]: time="2026-09-01T10:39:28.625Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TW64D0S99P6W0BSEGC4T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:28.612" grpc.time_ms=12.881 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2179gitlab # [ 451.884364] gitaly[922]: time="2026-09-01T10:39:28.649Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:39:58.648" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:28.648" grpc.time_ms=1.131 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 451.896389] gitaly[922]: time="2026-09-01T10:39:28.659Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=298 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-01T10:39:58.653" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:28.653" grpc.time_ms=5.664 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 451.911787] gitlab-workhorse[820]: time="2026-09-01T10:39:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672182gitlab # [ 451.913719] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1012183gitlab # [ 451.915572] gitaly[922]: time="2026-09-01T10:39:28.713Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:38.264" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:28.695" grpc.time_ms=18.355 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 451.928510] gitaly[922]: time="2026-09-01T10:39:28.728Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TWBMC7B5JYTR2CHCY738 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:28.716" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2185gitlab # [ 451.939397] gitaly[922]: time="2026-09-01T10:39:28.728Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TWBMC7B5JYTR2CHCY738 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:28.716" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2186gitlab # [ 451.952854] nixbot[3708]: {"ts": "2026-09-01T10:39:28.779Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2187gitlab # [ 451.955251] gitaly[922]: time="2026-09-01T10:39:28.729Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TWBMC7B5JYTR2CHCY738 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:28.716" grpc.time_ms=13.199 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2188gitlab # [ 452.047408] gitaly[922]: time="2026-09-01T10:39:28.891Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TWGZ8HK0P648PYGP3D1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:58.589" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:28.890" grpc.time_ms=1.053 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 452.156929] gitaly[922]: time="2026-09-01T10:39:29.001Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TWGZ8HK0P648PYGP3D1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:38.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:28.985" grpc.time_ms=15.342 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2190gitlab # [ 452.232277] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2762191gitlab # [ 452.240354] nixbot[3708]: {"ts": "2026-09-01T10:39:29.077Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a \"HTTP/1.1 201 Created\""}2192gitlab # [ 452.329207] gitaly[922]: time="2026-09-01T10:39:29.173Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TWSTX4NB8ZPMD0Y8KC2D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:59.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:29.172" grpc.time_ms=1.091 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 452.424687] gitaly[922]: time="2026-09-01T10:39:29.268Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TWSTX4NB8ZPMD0Y8KC2D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:39.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:29.251" grpc.time_ms=17.378 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 452.522657] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2842195gitlab # [ 452.525388] nixbot[3708]: {"ts": "2026-09-01T10:39:29.369Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a \"HTTP/1.1 201 Created\""}2196gitlab # [ 452.561432] gitaly[922]: time="2026-09-01T10:39:29.405Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-01T10:39:59.376" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:29.377" grpc.time_ms=28.263 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 452.589909] gitaly[922]: time="2026-09-01T10:39:29.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8R1M66T4BJ2MYA9B6R6A6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-01T10:39:59.411" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:29.412" grpc.time_ms=22.036 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab # [ 452.618671] sidekiq-cluster[3646]: {"severity":"WARN","time":"2026-09-01T10:39:29.462Z","class":"CreatePipelineWorker","correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"df1df45dad5c717fe1052bdce23b6d1991c51b6a","after":"11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438","ref":"refs/heads/master"},"retry":0}2199gitlab # [ 452.632092] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3f17ac6fb6a898eb418b907d","created_at":"2026-09-01T10:39:25.169Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-c8c93c7547ac4808","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b3b9e3ff8d87e0b00c467ec565b0dfe1c12349aa05763b0cdc1869eeb977869c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:25.174Z","job_size_bytes":467,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3f17ac6fb6a898eb418b907d: done: 0.944486 sec","job_status":"done","queue_duration_s":3.356914,"scheduling_latency_s":3.356944,"gitaly_calls":7,"gitaly_duration_s":0.118565,"redis_calls":33,"redis_duration_s":0.008914,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000724,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003062,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003438,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.792554,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.944486,"completed_at":"2026-09-01T10:39:29.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030603,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 452.686283] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.479Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"e3a05bdc-5afb-4be0-bea6-1f11eac303cc\"}"],"class":"WebHookWorker","jid":"ea39df9fbaaed46186b7f324","created_at":"2026-09-01T10:39:25.203Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-c8c93c7547ac4808","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:01a17dd81e995046c624f8b4fdd7c2d127bcd21828fe0124aee06617531eaa03","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:25.207Z","job_size_bytes":1749,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ea39df9fbaaed46186b7f324: start","job_status":"start","queue_duration_s":4.271405,"scheduling_latency_s":4.271452}2201gitlab # [ 452.703852] nixbot[3708]: INFO: ::ffff:127.0.0.1:36622 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2202gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2203gitlab # [ 452.712108] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.553Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"e3a05bdc-5afb-4be0-bea6-1f11eac303cc\"}"],"class":"WebHookWorker","jid":"ea39df9fbaaed46186b7f324","created_at":"2026-09-01T10:39:25.203Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-c8c93c7547ac4808","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:01a17dd81e995046c624f8b4fdd7c2d127bcd21828fe0124aee06617531eaa03","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:25.207Z","job_size_bytes":1749,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-ea39df9fbaaed46186b7f324: done: 0.074839 sec","job_status":"done","queue_duration_s":4.271405,"scheduling_latency_s":4.271452,"redis_calls":14,"redis_duration_s":0.004464,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000546,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002378,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00154,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.010404180000023189,"cpu_s":0.04899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.074839,"completed_at":"2026-09-01T10:39:29.553Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003836,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2204gitlab # [ 452.760126] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.559Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bdf27bd263e2d67b6f26fbe1","created_at":"2026-09-01T10:39:26.043Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.051Z","job_size_bytes":23,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bdf27bd263e2d67b6f26fbe1: start","job_status":"start","queue_duration_s":3.507629,"scheduling_latency_s":3.507679}2205gitlab # [ 452.807177] nixbot[3708]: INFO: ::ffff:127.0.0.1:36630 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2206gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.07 seconds)2207gitlab # [ 452.815660] gitaly[922]: time="2026-09-01T10:39:29.659Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TX92D4AXDYVV1VW7Y307 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:29.650" grpc.time_ms=9.507 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2208gitlab # [ 452.830264] gitaly[922]: time="2026-09-01T10:39:29.674Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TX31CNS1TDCKPQ81GWM3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:39:59.065" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:29.666" grpc.time_ms=7.718 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2209gitlab # [ 452.843620] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1042210gitlab # [ 452.859029] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bdf27bd263e2d67b6f26fbe1","created_at":"2026-09-01T10:39:26.043Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.051Z","job_size_bytes":23,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bdf27bd263e2d67b6f26fbe1: done: 0.143923 sec","job_status":"done","queue_duration_s":3.507629,"scheduling_latency_s":3.507679,"redis_calls":10,"redis_duration_s":0.008712,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000609,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003743,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00098948,"duration_s":0.143923,"completed_at":"2026-09-01T10:39:29.703Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032917,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2211gitlab # [ 452.903424] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.709Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"86e6c10a2422a1f73443efe0","created_at":"2026-09-01T10:39:26.272Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.285Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-86e6c10a2422a1f73443efe0: start","job_status":"start","queue_duration_s":3.423712,"scheduling_latency_s":3.423757}2212gitlab # [ 452.920354] gitaly[922]: time="2026-09-01T10:39:29.758Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TX31CNS1TDCKPQ81GWM3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:39.065" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:29.746" grpc.time_ms=11.796 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 452.933644] gitaly[922]: time="2026-09-01T10:39:29.767Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXCFYN98M3JND6W2RMAS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:29.755" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2214gitlab # [ 452.943931] gitlab-workhorse[820]: time="2026-09-01T10:39:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672215gitlab # [ 452.945997] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 882216gitlab # [ 452.947874] gitaly[922]: time="2026-09-01T10:39:29.767Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXCFYN98M3JND6W2RMAS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:29.755" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2217gitlab # [ 452.962952] gitaly[922]: time="2026-09-01T10:39:29.767Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXCFYN98M3JND6W2RMAS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:29.755" grpc.time_ms=12.658 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2218gitlab # [ 452.977843] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.799Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"86e6c10a2422a1f73443efe0","created_at":"2026-09-01T10:39:26.272Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.285Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-86e6c10a2422a1f73443efe0: done: 0.090738 sec","job_status":"done","queue_duration_s":3.423712,"scheduling_latency_s":3.423757,"redis_calls":10,"redis_duration_s":0.012054,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001798,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007275,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002981,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066448,"duration_s":0.090738,"completed_at":"2026-09-01T10:39:29.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2219gitlab # [ 453.022263] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.802Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"991d546f1d2fe1caba11bca4","created_at":"2026-09-01T10:39:26.309Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.322Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-991d546f1d2fe1caba11bca4: start","job_status":"start","queue_duration_s":3.480166,"scheduling_latency_s":3.4802}2220gitlab # [ 453.038376] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.874Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"991d546f1d2fe1caba11bca4","created_at":"2026-09-01T10:39:26.309Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.322Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-991d546f1d2fe1caba11bca4: done: 0.071865 sec","job_status":"done","queue_duration_s":3.480166,"scheduling_latency_s":3.4802,"redis_calls":10,"redis_duration_s":0.009524,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002417,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005582,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003411,"duration_s":0.071865,"completed_at":"2026-09-01T10:39:29.874Z","load_balancing_strategy":"primary","db_duration_s":0.013383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2221gitlab # [ 453.082395] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.876Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b8c8395ffcc6060c5fc332c0","created_at":"2026-09-01T10:39:26.349Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.360Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b8c8395ffcc6060c5fc332c0: start","job_status":"start","queue_duration_s":3.516674,"scheduling_latency_s":3.516695}2222gitlab # [ 453.097873] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 4602223gitlab # [ 453.100280] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 732224gitlab # [ 453.102611] nixbot[3708]: {"ts": "2026-09-01T10:39:29.835Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/df1df45dad5c717fe1052bdce23b6d1991c51b6a \"HTTP/1.1 201 Created\""}2225gitlab # [ 453.105508] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.931Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b8c8395ffcc6060c5fc332c0","created_at":"2026-09-01T10:39:26.349Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.360Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b8c8395ffcc6060c5fc332c0: done: 0.054603 sec","job_status":"done","queue_duration_s":3.516674,"scheduling_latency_s":3.516695,"redis_calls":13,"redis_duration_s":0.009729999999999999,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00088,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003516,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.0049,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034858,"duration_s":0.054603,"completed_at":"2026-09-01T10:39:29.931Z","load_balancing_strategy":"primary","db_duration_s":0.006357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2226gitlab # [ 453.150338] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.933Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e3517d2f5812b82d1b70e246","created_at":"2026-09-01T10:39:26.361Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.369Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e3517d2f5812b82d1b70e246: start","job_status":"start","queue_duration_s":3.563252,"scheduling_latency_s":3.563269}2227gitlab # [ 453.167118] gitaly[922]: time="2026-09-01T10:39:29.893Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TXGXSKN5GBNM6PTWS7M3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:29.883" grpc.time_ms=9.831 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2228gitlab # [ 453.181088] gitaly[922]: time="2026-09-01T10:39:29.968Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXK8CZN014Q2E4HFXDDX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:29.959" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2229gitlab # [ 453.191185] gitlab-workhorse[820]: time="2026-09-01T10:39:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672230gitlab # [ 453.193113] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 722231gitlab # [ 453.195042] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.969Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e3517d2f5812b82d1b70e246","created_at":"2026-09-01T10:39:26.361Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.369Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e3517d2f5812b82d1b70e246: done: 0.036591 sec","job_status":"done","queue_duration_s":3.563252,"scheduling_latency_s":3.563269,"redis_calls":10,"redis_duration_s":0.001893,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000354,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032708,"duration_s":0.036591,"completed_at":"2026-09-01T10:39:29.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004247,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab # [ 453.239353] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:29.971Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a4b5d64c44c5821f1f3568f5","created_at":"2026-09-01T10:39:26.370Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.381Z","job_size_bytes":19,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a4b5d64c44c5821f1f3568f5: start","job_status":"start","queue_duration_s":3.58989,"scheduling_latency_s":3.589913}2233gitlab # [ 453.255636] gitaly[922]: time="2026-09-01T10:39:29.968Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXK8CZN014Q2E4HFXDDX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:29.959" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2234gitlab # [ 453.268946] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 582235gitlab # [ 453.271001] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.013Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a4b5d64c44c5821f1f3568f5","created_at":"2026-09-01T10:39:26.370Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.381Z","job_size_bytes":19,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a4b5d64c44c5821f1f3568f5: done: 0.042933 sec","job_status":"done","queue_duration_s":3.58989,"scheduling_latency_s":3.589913,"redis_calls":11,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000402,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001943,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000366,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026756,"duration_s":0.042933,"completed_at":"2026-09-01T10:39:30.013Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2236gitlab # [ 453.315740] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.015Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"55e56386d09f546c4815488b","created_at":"2026-09-01T10:39:26.386Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.394Z","job_size_bytes":66,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-55e56386d09f546c4815488b: start","job_status":"start","queue_duration_s":3.620484,"scheduling_latency_s":3.620503}2237gitlab # [ 453.334202] gitaly[922]: time="2026-09-01T10:39:29.968Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXK8CZN014Q2E4HFXDDX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:29.959" grpc.time_ms=9.222 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2238gitlab # [ 453.348403] gitlab-workhorse[820]: time="2026-09-01T10:39:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162239gitlab # [ 453.350247] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 812240gitlab # [ 453.352313] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.055Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"55e56386d09f546c4815488b","created_at":"2026-09-01T10:39:26.386Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.394Z","job_size_bytes":66,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-55e56386d09f546c4815488b: done: 0.040618 sec","job_status":"done","queue_duration_s":3.620484,"scheduling_latency_s":3.620503,"redis_calls":10,"redis_duration_s":0.0047469999999999995,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000484,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000356,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028588,"duration_s":0.040618,"completed_at":"2026-09-01T10:39:30.055Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2241gitlab # [ 453.398552] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.057Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"cc9944c4606ffd9441daa0f2","created_at":"2026-09-01T10:39:26.396Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.404Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-cc9944c4606ffd9441daa0f2: start","job_status":"start","queue_duration_s":3.652999,"scheduling_latency_s":3.65302}2242gitlab # [ 453.414964] gitaly[922]: time="2026-09-01T10:39:30.062Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TXPN010590KY2Y066898 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:30.053" grpc.time_ms=8.948 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2243gitlab # [ 453.428209] gitaly[922]: time="2026-09-01T10:39:30.147Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXRJPJ7WCBMZ5TQN38XW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:30.128" pid=922 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2244gitlab # [ 453.438213] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.100Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"cc9944c4606ffd9441daa0f2","created_at":"2026-09-01T10:39:26.396Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.404Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-cc9944c4606ffd9441daa0f2: done: 0.042847 sec","job_status":"done","queue_duration_s":3.652999,"scheduling_latency_s":3.65302,"redis_calls":10,"redis_duration_s":0.001527,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000401,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025564,"duration_s":0.042847,"completed_at":"2026-09-01T10:39:30.100Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2245gitlab # [ 453.482239] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.101Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e0684fc4dd79e1a6172a42a0","created_at":"2026-09-01T10:39:26.417Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.424Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e0684fc4dd79e1a6172a42a0: start","job_status":"start","queue_duration_s":3.677606,"scheduling_latency_s":3.677628}2246gitlab # [ 453.498441] gitaly[922]: time="2026-09-01T10:39:30.147Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXRJPJ7WCBMZ5TQN38XW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:30.128" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2247gitlab # [ 453.512581] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.140Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e0684fc4dd79e1a6172a42a0","created_at":"2026-09-01T10:39:26.417Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.424Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e0684fc4dd79e1a6172a42a0: done: 0.039262 sec","job_status":"done","queue_duration_s":3.677606,"scheduling_latency_s":3.677628,"redis_calls":10,"redis_duration_s":0.001754,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000328,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030364,"duration_s":0.039262,"completed_at":"2026-09-01T10:39:30.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007735,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2248gitlab # [ 453.556635] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.142Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4a69f7f604e19f313a078480","created_at":"2026-09-01T10:39:26.425Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.438Z","job_size_bytes":6,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4a69f7f604e19f313a078480: start","job_status":"start","queue_duration_s":3.703814,"scheduling_latency_s":3.703838}2249gitlab # [ 453.573047] gitaly[922]: time="2026-09-01T10:39:30.149Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXRJPJ7WCBMZ5TQN38XW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-01T10:39:30.128" grpc.time_ms=19.742 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc2250gitlab # [ 453.587839] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.170Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4a69f7f604e19f313a078480","created_at":"2026-09-01T10:39:26.425Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.438Z","job_size_bytes":6,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4a69f7f604e19f313a078480: done: 0.027539 sec","job_status":"done","queue_duration_s":3.703814,"scheduling_latency_s":3.703838,"redis_calls":10,"redis_duration_s":0.002322,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000507,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001495,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026312,"duration_s":0.027539,"completed_at":"2026-09-01T10:39:30.169Z","load_balancing_strategy":"primary","db_duration_s":0.002266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2251gitlab # [ 453.633240] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.171Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3a2d9f58763700e0ea6a777a","created_at":"2026-09-01T10:39:26.440Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.452Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3a2d9f58763700e0ea6a777a: start","job_status":"start","queue_duration_s":3.718764,"scheduling_latency_s":3.718785}2252gitlab # [ 453.648907] gitaly[922]: time="2026-09-01T10:39:30.271Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:00.168" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:30.268" grpc.time_ms=2.627 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 453.661683] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.218Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3a2d9f58763700e0ea6a777a","created_at":"2026-09-01T10:39:26.440Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.452Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3a2d9f58763700e0ea6a777a: done: 0.046765 sec","job_status":"done","queue_duration_s":3.718764,"scheduling_latency_s":3.718785,"redis_calls":10,"redis_duration_s":0.0037089999999999996,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000374,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000539,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051312,"duration_s":0.046765,"completed_at":"2026-09-01T10:39:30.218Z","load_balancing_strategy":"primary","db_duration_s":0.010584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2254gitlab # [ 453.707890] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.219Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"d39ad5ec6f97fc9b5701d9b9","created_at":"2026-09-01T10:39:26.465Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.476Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-d39ad5ec6f97fc9b5701d9b9: start","job_status":"start","queue_duration_s":3.742707,"scheduling_latency_s":3.742729}2255gitlab # [ 453.724177] gitaly[922]: time="2026-09-01T10:39:30.296Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-01T10:40:00.182" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:30.283" grpc.time_ms=13.301 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 453.737602] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.316Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"d39ad5ec6f97fc9b5701d9b9","created_at":"2026-09-01T10:39:26.465Z","trace_propagation_headers":{"sentry-trace":"d1d92300d6c94e9d9f62c22c26a3ca1b-9f9bca1da85b4fda","baggage":"sentry-trace_id=d1d92300d6c94e9d9f62c22c26a3ca1b,sentry-release=Unknown"},"correlation_id":"01M1E8R33QEZNV7H3NV767CF4Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.476Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-d39ad5ec6f97fc9b5701d9b9: done: 0.097308 sec","job_status":"done","queue_duration_s":3.742707,"scheduling_latency_s":3.742729,"redis_calls":14,"redis_duration_s":0.005944,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002834,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061148,"duration_s":0.097308,"completed_at":"2026-09-01T10:39:30.316Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2257gitlab # [ 453.781297] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.318Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ca6c1ca5cb155de8ee7ce986","created_at":"2026-09-01T10:39:26.780Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-d7fe428f9be44f81","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.792Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ca6c1ca5cb155de8ee7ce986: start","job_status":"start","queue_duration_s":3.526424,"scheduling_latency_s":3.526451}2258gitlab # [ 453.798610] gitaly[922]: time="2026-09-01T10:39:30.326Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:40.069" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:30.310" grpc.time_ms=16.264 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab # [ 453.812063] nixbot[3708]: {"ts": "2026-09-01T10:39:30.630Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 \"HTTP/1.1 201 Created\""}2260gitlab # [ 453.814750] nixbot[3708]: {"ts": "2026-09-01T10:39:30.639Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-11ed4f15e929-4"}2261gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438'2262gitlab # [ 453.817264] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.369Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ca6c1ca5cb155de8ee7ce986","created_at":"2026-09-01T10:39:26.780Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-d7fe428f9be44f81","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:26.792Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ca6c1ca5cb155de8ee7ce986: done: 0.050528 sec","job_status":"done","queue_duration_s":3.526424,"scheduling_latency_s":3.526451,"redis_calls":19,"redis_duration_s":0.003359,"redis_read_bytes":21,"redis_write_bytes":4289,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00054,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2260,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001574,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00771058,"duration_s":0.050528,"completed_at":"2026-09-01T10:39:30.368Z","load_balancing_strategy":"primary","db_duration_s":0.007682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2263gitlab # [ 453.859617] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.370Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","4e85466d32f6bff9b2cdab80"],"class":"WebHooks::LogExecutionWorker","jid":"4575a348326e15be4fff53c9","created_at":"2026-09-01T10:39:28.410Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-668c187f6a8f4580","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38c074f88b05acc294b67f606b53341f5e0834933e89b8dc7f96747fc16fb6c5","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:28.422Z","job_size_bytes":2593,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4575a348326e15be4fff53c9: start","job_status":"start","queue_duration_s":1.947705,"scheduling_latency_s":1.947724}2264gitlab # [ 453.876811] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4242265gitlab # [ 453.879655] gitaly[922]: time="2026-09-01T10:39:30.360Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-01T10:39:40.119" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:30.360" grpc.time_ms=0.377 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2266gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', in 0.08 seconds)2267(finished: subtest: push delivers the webhook, in 95.37 seconds)2268subtest: eval and build post commit statuses2269gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses2270gitlab # [ 453.890643] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.422Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","4e85466d32f6bff9b2cdab80"],"class":"WebHooks::LogExecutionWorker","jid":"4575a348326e15be4fff53c9","created_at":"2026-09-01T10:39:28.410Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-668c187f6a8f4580","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38c074f88b05acc294b67f606b53341f5e0834933e89b8dc7f96747fc16fb6c5","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:28.422Z","job_size_bytes":2593,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4575a348326e15be4fff53c9: done: 0.051984 sec","job_status":"done","queue_duration_s":1.947705,"scheduling_latency_s":1.947724,"redis_calls":10,"redis_duration_s":0.002253,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000346,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027474,"duration_s":0.051984,"completed_at":"2026-09-01T10:39:30.422Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2271gitlab # [ 453.934563] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.423Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"4b5a46de6b8e57ceddf69efb","created_at":"2026-09-01T10:39:29.048Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-55e75c67608f4aaa","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:29.054Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4b5a46de6b8e57ceddf69efb: start","job_status":"start","queue_duration_s":1.368776,"scheduling_latency_s":1.368794}2272gitlab # [ 453.950229] nixbot[3708]: INFO: ::ffff:127.0.0.1:36632 - "GET /api/repos/gitlab/root/test-flake/builds?commit=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 200 OK2273gitlab # [ 453.952132] nixbot[3708]: {"ts": "2026-09-01T10:39:30.789Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-11ed4f15e929-4", "argv0": "bwrap"}2274gitlab # [ 453.954432] gitaly[922]: time="2026-09-01T10:39:30.382Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-01T10:39:40.130" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:30.370" grpc.time_ms=11.728 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2275gitlab # [ 453.967518] gitaly[922]: time="2026-09-01T10:39:30.449Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:30.448" grpc.time_ms=0.565 pid=922 span.kind=server system=grpc2276gitlab # [ 453.976857] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.723Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"4b5a46de6b8e57ceddf69efb","created_at":"2026-09-01T10:39:29.048Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-55e75c67608f4aaa","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:29.054Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3646,"job_status":"rescheduled","message":"PipelineProcessWorker JID-4b5a46de6b8e57ceddf69efb: rescheduled"}2277gitlab # [ 453.991371] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.742Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"4b5a46de6b8e57ceddf69efb","created_at":"2026-09-01T10:39:29.048Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-55e75c67608f4aaa","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:29.054Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4b5a46de6b8e57ceddf69efb: done: 0.318342 sec","job_status":"done","queue_duration_s":1.368776,"scheduling_latency_s":1.368794,"gitaly_calls":3,"gitaly_duration_s":0.123977,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012635,"redis_read_bytes":151,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000509,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000843,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003032,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.00536,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000269,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000379,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001734,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.138672,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.26068402,"duration_s":0.318342,"completed_at":"2026-09-01T10:39:30.742Z","load_balancing_strategy":"primary","db_duration_s":0.045837,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2278gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses, in 0.15 seconds)2279gitlab # [ 454.043778] gitaly[922]: time="2026-09-01T10:39:30.497Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:30.495" grpc.time_ms=2.062 pid=922 span.kind=server system=grpc2280gitlab # [ 454.053065] gitaly[922]: time="2026-09-01T10:39:30.506Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q diskcache=dbd4d81e-16a4-4838-abb6-2a120a1885c5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:39:40.146" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:30.387" pid=922 ref=refs/keep-around/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 remote_ip="2001:db8:1::1" revision=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 span.kind=server system=grpc username=root2281gitlab # [ 454.064260] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.744Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ea39df9fbaaed46186b7f324"],"class":"WebHooks::LogExecutionWorker","jid":"2c4fdef841d29b1a0b5e96ca","created_at":"2026-09-01T10:39:29.532Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-c36ee6836eee4598","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d48f40997446f6540faf26815f4b220db152cad5d8d57d64dbc71ab9f531cb1a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:29.538Z","job_size_bytes":2591,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2c4fdef841d29b1a0b5e96ca: start","job_status":"start","queue_duration_s":1.206409,"scheduling_latency_s":1.206441}2282gitlab # [ 454.080701] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.783Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","ea39df9fbaaed46186b7f324"],"class":"WebHooks::LogExecutionWorker","jid":"2c4fdef841d29b1a0b5e96ca","created_at":"2026-09-01T10:39:29.532Z","trace_propagation_headers":{"sentry-trace":"356920d2e3814356819b895986971a1b-c36ee6836eee4598","baggage":"sentry-trace_id=356920d2e3814356819b895986971a1b,sentry-release=Unknown"},"correlation_id":"01M1E8R1M66T4BJ2MYA9B6R6A6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d48f40997446f6540faf26815f4b220db152cad5d8d57d64dbc71ab9f531cb1a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:29.538Z","job_size_bytes":2591,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2c4fdef841d29b1a0b5e96ca: done: 0.038246 sec","job_status":"done","queue_duration_s":1.206409,"scheduling_latency_s":1.206441,"redis_calls":7,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038246,"completed_at":"2026-09-01T10:39:30.782Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2283gitlab # [ 454.123412] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1172284gitlab # [ 454.126518] gitaly[922]: time="2026-09-01T10:39:30.507Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=109 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5361 command.oublock=8 command.real_time_ms=113 command.spawn_token_fork_ms=4 command.system_time_ms=71 command.user_time_ms=38 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-01T10:39:40.146" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-01T10:39:30.387" grpc.time_ms=119.431 pid=922 ref=refs/keep-around/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 remote_ip="2001:db8:1::1" revision=11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 span.kind=server system=grpc username=root2285gitlab # [ 454.141426] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.784Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"99b84d62d265809fb1ae401e","created_at":"2026-09-01T10:39:30.355Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-491bdbf369974098","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.360Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-99b84d62d265809fb1ae401e: start","job_status":"start","queue_duration_s":0.423894,"scheduling_latency_s":0.42392}2286gitlab # [ 454.158043] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.884Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"99b84d62d265809fb1ae401e","created_at":"2026-09-01T10:39:30.355Z","trace_propagation_headers":{"sentry-trace":"b6a2a50ebfa740ddae2af4c5d5545731-491bdbf369974098","baggage":"sentry-trace_id=b6a2a50ebfa740ddae2af4c5d5545731,sentry-release=Unknown"},"correlation_id":"01M1E8QWABT18F7BR2MHWWHN4E","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.360Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-99b84d62d265809fb1ae401e: done: 0.099614 sec","job_status":"done","queue_duration_s":0.423894,"scheduling_latency_s":0.42392,"redis_calls":11,"redis_duration_s":0.006618,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000372,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005402,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040506,"duration_s":0.099614,"completed_at":"2026-09-01T10:39:30.884Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2287gitlab # [ 454.203340] nix-daemon[3936]: accepted connection from pid 4591, user nixbot2288gitlab # [ 454.204354] gitaly[922]: time="2026-09-01T10:39:30.512Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:00.411" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:30.511" grpc.time_ms=0.404 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2289gitlab # [ 454.216987] gitaly[922]: time="2026-09-01T10:39:30.537Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8TWGZ8HK0P648PYGP3D1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:30.536" grpc.time_ms=0.653 pid=922 span.kind=server system=grpc2290gitlab # [ 454.226476] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.885Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"04faece70b52c2e3b860598b","created_at":"2026-09-01T10:39:30.490Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.492Z","job_size_bytes":23,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-04faece70b52c2e3b860598b: start","job_status":"start","queue_duration_s":0.393177,"scheduling_latency_s":0.393201}2291gitlab # [ 454.243003] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.930Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"04faece70b52c2e3b860598b","created_at":"2026-09-01T10:39:30.490Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.492Z","job_size_bytes":23,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-04faece70b52c2e3b860598b: done: 0.044979 sec","job_status":"done","queue_duration_s":0.393177,"scheduling_latency_s":0.393201,"redis_calls":7,"redis_duration_s":0.001301,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044979,"completed_at":"2026-09-01T10:39:30.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007285,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2292gitlab # [ 454.285587] gitaly[922]: time="2026-09-01T10:39:30.569Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8TWGZ8HK0P648PYGP3D1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:30.568" grpc.time_ms=0.767 pid=922 span.kind=server system=grpc2293gitlab # [ 454.294969] gitaly[922]: time="2026-09-01T10:39:30.602Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8TWGZ8HK0P648PYGP3D1H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:30.601" grpc.time_ms=0.461 pid=922 span.kind=server system=grpc2294gitlab # [ 454.304649] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.932Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"0632203ce7182019baa7927b","created_at":"2026-09-01T10:39:30.514Z","trace_propagation_headers":{"sentry-trace":"b0b5bf024bb541c3a7c8d5048ea3997f-60261d8d4a9d4003","baggage":"sentry-trace_id=b0b5bf024bb541c3a7c8d5048ea3997f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TXWWTHX96H9QKBQ14A2Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.520Z","job_size_bytes":65,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-0632203ce7182019baa7927b: start","job_status":"start","queue_duration_s":0.411743,"scheduling_latency_s":0.411767}2295gitlab # [ 454.321111] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.963Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"0632203ce7182019baa7927b","created_at":"2026-09-01T10:39:30.514Z","trace_propagation_headers":{"sentry-trace":"b0b5bf024bb541c3a7c8d5048ea3997f-60261d8d4a9d4003","baggage":"sentry-trace_id=b0b5bf024bb541c3a7c8d5048ea3997f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TXWWTHX96H9QKBQ14A2Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.520Z","job_size_bytes":65,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-0632203ce7182019baa7927b: done: 0.031107 sec","job_status":"done","queue_duration_s":0.411743,"scheduling_latency_s":0.411767,"redis_calls":7,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031107,"completed_at":"2026-09-01T10:39:30.963Z","load_balancing_strategy":"primary","db_duration_s":0.003858,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2296gitlab # [ 454.363996] gitaly[922]: time="2026-09-01T10:39:30.609Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TWGZ8HK0P648PYGP3D1H diskcache=938e89cd-38b6-4810-90da-e58a99a50ff4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:40:00.499" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:30.499" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2297gitlab # [ 454.373616] gitaly[922]: time="2026-09-01T10:39:30.609Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=90 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7058 command.oublock=0 command.real_time_ms=104 command.spawn_token_fork_ms=1 command.system_time_ms=53 command.user_time_ms=37 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TWGZ8HK0P648PYGP3D1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:40:00.499" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:30.499" grpc.time_ms=109.672 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2298gitlab # [ 454.386456] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:30.966Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e9a776124671e76f5270d8a6","created_at":"2026-09-01T10:39:30.521Z","trace_propagation_headers":{"sentry-trace":"b0b5bf024bb541c3a7c8d5048ea3997f-60261d8d4a9d4003","baggage":"sentry-trace_id=b0b5bf024bb541c3a7c8d5048ea3997f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TXWWTHX96H9QKBQ14A2Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.525Z","job_size_bytes":65,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e9a776124671e76f5270d8a6: start","job_status":"start","queue_duration_s":0.44103,"scheduling_latency_s":0.441056}2299gitlab # [ 454.403945] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.020Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e9a776124671e76f5270d8a6","created_at":"2026-09-01T10:39:30.521Z","trace_propagation_headers":{"sentry-trace":"b0b5bf024bb541c3a7c8d5048ea3997f-60261d8d4a9d4003","baggage":"sentry-trace_id=b0b5bf024bb541c3a7c8d5048ea3997f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TXWWTHX96H9QKBQ14A2Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.525Z","job_size_bytes":65,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e9a776124671e76f5270d8a6: done: 0.053538 sec","job_status":"done","queue_duration_s":0.44103,"scheduling_latency_s":0.441056,"redis_calls":10,"redis_duration_s":0.002909,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001267,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053538,"completed_at":"2026-09-01T10:39:31.020Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 454.448971] gitaly[922]: time="2026-09-01T10:39:30.667Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TWGZ8HK0P648PYGP3D1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:40:00.666" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:30.666" grpc.time_ms=0.92 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab # [ 454.461554] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.022Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f2b8836730d2e4352a81e634","created_at":"2026-09-01T10:39:30.605Z","trace_propagation_headers":{"sentry-trace":"b0b5bf024bb541c3a7c8d5048ea3997f-60261d8d4a9d4003","baggage":"sentry-trace_id=b0b5bf024bb541c3a7c8d5048ea3997f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TXWWTHX96H9QKBQ14A2Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.609Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f2b8836730d2e4352a81e634: start","job_status":"start","queue_duration_s":0.412955,"scheduling_latency_s":0.412978}2302gitlab # [ 454.477135] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.163Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f2b8836730d2e4352a81e634","created_at":"2026-09-01T10:39:30.605Z","trace_propagation_headers":{"sentry-trace":"b0b5bf024bb541c3a7c8d5048ea3997f-60261d8d4a9d4003","baggage":"sentry-trace_id=b0b5bf024bb541c3a7c8d5048ea3997f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8TXWWTHX96H9QKBQ14A2Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.609Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f2b8836730d2e4352a81e634: done: 0.141099 sec","job_status":"done","queue_duration_s":0.412955,"scheduling_latency_s":0.412978,"gitaly_calls":2,"gitaly_duration_s":0.008353,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008472,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001344,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001239,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000399,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001905,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000323,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000703,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001215,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094738,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10725822,"duration_s":0.141099,"completed_at":"2026-09-01T10:39:31.163Z","load_balancing_strategy":"primary","db_duration_s":0.037891,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2303gitlab # [ 454.528107] gitaly[922]: time="2026-09-01T10:39:30.702Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TWGZ8HK0P648PYGP3D1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:00.700" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:30.701" grpc.time_ms=1.156 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2304gitlab # [ 454.540429] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.164Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"377168e6e0a545caac2470f4","created_at":"2026-09-01T10:39:30.614Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.616Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-377168e6e0a545caac2470f4: start","job_status":"start","queue_duration_s":0.548181,"scheduling_latency_s":0.548198}2305gitlab # [ 454.556803] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.196Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"377168e6e0a545caac2470f4","created_at":"2026-09-01T10:39:30.614Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.616Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-377168e6e0a545caac2470f4: done: 0.031518 sec","job_status":"done","queue_duration_s":0.548181,"scheduling_latency_s":0.548198,"redis_calls":7,"redis_duration_s":0.001823,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031518,"completed_at":"2026-09-01T10:39:31.196Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2306gitlab # [ 454.598850] gitaly[922]: time="2026-09-01T10:39:30.846Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TYEGWM0ZFCE3KR3K4FB4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:00.245" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:30.845" grpc.time_ms=0.682 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2307gitlab # [ 454.612348] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.198Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a655cd4d646dac77df6bf4ae","created_at":"2026-09-01T10:39:30.627Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.630Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a655cd4d646dac77df6bf4ae: start","job_status":"start","queue_duration_s":0.567391,"scheduling_latency_s":0.56741}2308gitlab # [ 454.627918] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.230Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a655cd4d646dac77df6bf4ae","created_at":"2026-09-01T10:39:30.627Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.630Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a655cd4d646dac77df6bf4ae: done: 0.032439 sec","job_status":"done","queue_duration_s":0.567391,"scheduling_latency_s":0.56741,"redis_calls":7,"redis_duration_s":0.00176,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001286,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032439,"completed_at":"2026-09-01T10:39:31.230Z","load_balancing_strategy":"primary","db_duration_s":0.008003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2309gitlab # [ 454.669056] gitaly[922]: time="2026-09-01T10:39:31.106Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:40:01.103" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:31.104" grpc.time_ms=1.475 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2310gitlab # [ 454.681893] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.232Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1c72bbf27b7855167e5f9af4","created_at":"2026-09-01T10:39:30.638Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.641Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1c72bbf27b7855167e5f9af4: start","job_status":"start","queue_duration_s":0.591398,"scheduling_latency_s":0.591418}2311gitlab # [ 454.697034] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.267Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1c72bbf27b7855167e5f9af4","created_at":"2026-09-01T10:39:30.638Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.641Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1c72bbf27b7855167e5f9af4: done: 0.035147 sec","job_status":"done","queue_duration_s":0.591398,"scheduling_latency_s":0.591418,"redis_calls":10,"redis_duration_s":0.002657,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001313,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000804,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00054,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035147,"completed_at":"2026-09-01T10:39:31.267Z","load_balancing_strategy":"primary","db_duration_s":0.008188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 454.739654] gitaly[922]: time="2026-09-01T10:39:31.151Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TXWWTHX96H9QKBQ14A2Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:01.148" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:31.149" grpc.time_ms=1.174 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 454.752026] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.269Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5afaaebcd0385215d0483618","created_at":"2026-09-01T10:39:30.641Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.643Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5afaaebcd0385215d0483618: start","job_status":"start","queue_duration_s":0.62578,"scheduling_latency_s":0.6258}2314gitlab # [ 454.768080] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.299Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5afaaebcd0385215d0483618","created_at":"2026-09-01T10:39:30.641Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.643Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5afaaebcd0385215d0483618: done: 0.029902 sec","job_status":"done","queue_duration_s":0.62578,"scheduling_latency_s":0.6258,"redis_calls":7,"redis_duration_s":0.00187,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029902,"completed_at":"2026-09-01T10:39:31.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006985,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 454.810027] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.300Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3634094a20add0b3d90a87a4","created_at":"2026-09-01T10:39:30.644Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.646Z","job_size_bytes":19,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3634094a20add0b3d90a87a4: start","job_status":"start","queue_duration_s":0.654903,"scheduling_latency_s":0.654923}2316gitlab # [ 454.826925] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.328Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3634094a20add0b3d90a87a4","created_at":"2026-09-01T10:39:30.644Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.646Z","job_size_bytes":19,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3634094a20add0b3d90a87a4: done: 0.027952 sec","job_status":"done","queue_duration_s":0.654903,"scheduling_latency_s":0.654923,"redis_calls":8,"redis_duration_s":0.0021550000000000002,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00167,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027952,"completed_at":"2026-09-01T10:39:31.328Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 454.868366] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.330Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"eaec441a051fa3c0459ef16b","created_at":"2026-09-01T10:39:30.646Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.648Z","job_size_bytes":66,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-eaec441a051fa3c0459ef16b: start","job_status":"start","queue_duration_s":0.681865,"scheduling_latency_s":0.681884}2318gitlab # [ 454.885122] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.355Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"eaec441a051fa3c0459ef16b","created_at":"2026-09-01T10:39:30.646Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.648Z","job_size_bytes":66,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-eaec441a051fa3c0459ef16b: done: 0.025508 sec","job_status":"done","queue_duration_s":0.681865,"scheduling_latency_s":0.681884,"redis_calls":7,"redis_duration_s":0.001881,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001345,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000536,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025508,"completed_at":"2026-09-01T10:39:31.355Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 454.927879] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.357Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6700eabd3b0ebbe9488b8ff8","created_at":"2026-09-01T10:39:30.649Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.650Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6700eabd3b0ebbe9488b8ff8: start","job_status":"start","queue_duration_s":0.706897,"scheduling_latency_s":0.706916}2320gitlab # [ 454.943974] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.385Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6700eabd3b0ebbe9488b8ff8","created_at":"2026-09-01T10:39:30.649Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.650Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6700eabd3b0ebbe9488b8ff8: done: 0.028122 sec","job_status":"done","queue_duration_s":0.706897,"scheduling_latency_s":0.706916,"redis_calls":7,"redis_duration_s":0.001829,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028122,"completed_at":"2026-09-01T10:39:31.385Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 454.985517] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.388Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"00fce50ec818805d9852fcf9","created_at":"2026-09-01T10:39:30.651Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.652Z","job_size_bytes":6,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-00fce50ec818805d9852fcf9: start","job_status":"start","queue_duration_s":0.735335,"scheduling_latency_s":0.735355}2322gitlab # [ 455.001001] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.409Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"00fce50ec818805d9852fcf9","created_at":"2026-09-01T10:39:30.651Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.652Z","job_size_bytes":6,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-00fce50ec818805d9852fcf9: done: 0.020876 sec","job_status":"done","queue_duration_s":0.735335,"scheduling_latency_s":0.735355,"redis_calls":7,"redis_duration_s":0.0024939999999999997,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020876,"completed_at":"2026-09-01T10:39:31.408Z","load_balancing_strategy":"primary","db_duration_s":0.000674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2323gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses2324gitlab # [ 455.043353] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3db53918035a610c83f0b5b6","created_at":"2026-09-01T10:39:30.653Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.654Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3db53918035a610c83f0b5b6: start","job_status":"start","queue_duration_s":0.757842,"scheduling_latency_s":0.757885}2325gitlab # [ 455.057748] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.472Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3db53918035a610c83f0b5b6","created_at":"2026-09-01T10:39:30.653Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.654Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3db53918035a610c83f0b5b6: done: 0.059836 sec","job_status":"done","queue_duration_s":0.757842,"scheduling_latency_s":0.757885,"redis_calls":7,"redis_duration_s":0.0034950000000000003,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059836,"completed_at":"2026-09-01T10:39:31.472Z","load_balancing_strategy":"primary","db_duration_s":0.007058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2326gitlab # [ 455.095921] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.475Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"fc8666ccfc07cd85f9534fd7","created_at":"2026-09-01T10:39:30.723Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.730Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fc8666ccfc07cd85f9534fd7: start","job_status":"start","queue_duration_s":0.744968,"scheduling_latency_s":0.745006}2327gitlab # [ 455.141333] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.526Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"fc8666ccfc07cd85f9534fd7","created_at":"2026-09-01T10:39:30.723Z","trace_propagation_headers":{"sentry-trace":"5b0c6980cd9449109b6b71f2a7f2a3e8-526fd461fd6d48cc","baggage":"sentry-trace_id=5b0c6980cd9449109b6b71f2a7f2a3e8,sentry-release=Unknown"},"correlation_id":"01M1E8TWGZ8HK0P648PYGP3D1H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:30.730Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fc8666ccfc07cd85f9534fd7: done: 0.051198 sec","job_status":"done","queue_duration_s":0.744968,"scheduling_latency_s":0.745006,"redis_calls":8,"redis_duration_s":0.003328,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002522,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000806,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051198,"completed_at":"2026-09-01T10:39:31.526Z","load_balancing_strategy":"primary","db_duration_s":0.006987,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2328gitlab # [ 455.210002] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.529Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2e1b5410795d21211156b397","created_at":"2026-09-01T10:39:31.086Z","trace_propagation_headers":{"sentry-trace":"b0b5bf024bb541c3a7c8d5048ea3997f-a5b2a3f10624449a","baggage":"sentry-trace_id=b0b5bf024bb541c3a7c8d5048ea3997f,sentry-release=Unknown"},"correlation_id":"01M1E8TXWWTHX96H9QKBQ14A2Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:31.088Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2e1b5410795d21211156b397: start","job_status":"start","queue_duration_s":0.440837,"scheduling_latency_s":0.440869}2329gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses, in 0.26 seconds)2330gitlab # [ 455.257875] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:31.585Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2e1b5410795d21211156b397","created_at":"2026-09-01T10:39:31.086Z","trace_propagation_headers":{"sentry-trace":"b0b5bf024bb541c3a7c8d5048ea3997f-a5b2a3f10624449a","baggage":"sentry-trace_id=b0b5bf024bb541c3a7c8d5048ea3997f,sentry-release=Unknown"},"correlation_id":"01M1E8TXWWTHX96H9QKBQ14A2Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:31.088Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2e1b5410795d21211156b397: done: 0.056676 sec","job_status":"done","queue_duration_s":0.440837,"scheduling_latency_s":0.440869,"redis_calls":7,"redis_duration_s":0.002441,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041562,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056676,"completed_at":"2026-09-01T10:39:31.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 455.324528] gitaly[922]: time="2026-09-01T10:39:32.085Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8TZMBWQR6NH3ZBCPHSPR6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:02.082" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:32.083" grpc.time_ms=1.263 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 455.341642] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1632333gitlab # [ 455.492945] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:32.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"583fdccfbc19bebe87c029c0","created_at":"2026-09-01T10:39:32.313Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7d13e1e3e598e09f06f490621d8f120","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.333Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-583fdccfbc19bebe87c029c0: start","job_status":"start","queue_duration_s":0.003236,"scheduling_latency_s":0.003293}2334gitlab # [ 455.566353] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:32.410Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2335gitlab # [ 455.603301] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:32.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"583fdccfbc19bebe87c029c0","created_at":"2026-09-01T10:39:32.313Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7d13e1e3e598e09f06f490621d8f120","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.333Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-583fdccfbc19bebe87c029c0: done: 0.110216 sec","job_status":"done","queue_duration_s":0.003236,"scheduling_latency_s":0.003293,"redis_calls":9,"redis_duration_s":0.01773,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002441,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009935,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005354,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.110216,"completed_at":"2026-09-01T10:39:32.446Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001309,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2336gitlab # [ 455.706708] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:32.451Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"89b2b6510c1192bbe1d38b9a","created_at":"2026-09-01T10:39:32.351Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45ad6ef9e803c94e48ef13fe8ada2f99","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:39:32.363Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-89b2b6510c1192bbe1d38b9a: start","job_status":"start","queue_duration_s":0.087627,"scheduling_latency_s":0.087679}2337gitlab # [ 455.728117] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:32.496Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2338gitlab # [ 455.733299] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:32.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"89b2b6510c1192bbe1d38b9a","created_at":"2026-09-01T10:39:32.351Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45ad6ef9e803c94e48ef13fe8ada2f99","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-01T10:39:32.363Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-89b2b6510c1192bbe1d38b9a: done: 0.095516 sec","job_status":"done","queue_duration_s":0.087627,"scheduling_latency_s":0.087679,"redis_calls":9,"redis_duration_s":0.011425,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00179,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008058,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001577,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.095516,"completed_at":"2026-09-01T10:39:32.546Z","load_balancing_strategy":"primary","db_duration_s":0.002804,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2339gitlab # [ 455.779568] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:32.556Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"68c8b025ae6a33adec9db771","created_at":"2026-09-01T10:39:32.369Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11bdbd79a1592110dee3927700f1f465","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:39:32.393Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-68c8b025ae6a33adec9db771: start","job_status":"start","queue_duration_s":0.162757,"scheduling_latency_s":0.16281}2340gitlab # [ 455.909948] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:32.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"68c8b025ae6a33adec9db771","created_at":"2026-09-01T10:39:32.369Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11bdbd79a1592110dee3927700f1f465","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-01T10:39:32.393Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-68c8b025ae6a33adec9db771: done: 0.196933 sec","job_status":"done","queue_duration_s":0.162757,"scheduling_latency_s":0.16281,"redis_calls":9,"redis_duration_s":0.034385,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.019001,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009332,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.196933,"completed_at":"2026-09-01T10:39:32.753Z","load_balancing_strategy":"primary","db_duration_s":0.01142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2341gitlab # [ 455.998298] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:32.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d485c71363348452562d5ff1","created_at":"2026-09-01T10:39:32.419Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b1ec1abf22586897f613cffb61c8e23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.491Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d485c71363348452562d5ff1: start","job_status":"start","queue_duration_s":0.27449,"scheduling_latency_s":0.274542}2342gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses2343gitlab # [ 456.361119] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:33.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d485c71363348452562d5ff1","created_at":"2026-09-01T10:39:32.419Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b1ec1abf22586897f613cffb61c8e23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.491Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d485c71363348452562d5ff1: done: 0.437967 sec","job_status":"done","queue_duration_s":0.27449,"scheduling_latency_s":0.274542,"redis_calls":11,"redis_duration_s":0.029453,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010509,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.056,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.230888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.437967,"completed_at":"2026-09-01T10:39:33.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2344gitlab # [ 456.452760] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:33.229Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"249a60f4339df303d7d2a57e","created_at":"2026-09-01T10:39:32.522Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.550Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-249a60f4339df303d7d2a57e: start","job_status":"start","queue_duration_s":0.678737,"scheduling_latency_s":0.678788}2345gitlab # [ 456.475094] gitaly[922]: time="2026-09-01T10:39:33.318Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V0TYXHJS1M3FYR3A932M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:03.215" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:33.316" grpc.time_ms=1.349 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2346gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses, in 0.22 seconds)2347gitlab # [ 456.523399] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1522348gitlab # [ 456.605399] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:33.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"249a60f4339df303d7d2a57e","created_at":"2026-09-01T10:39:32.522Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.550Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-249a60f4339df303d7d2a57e: done: 0.219281 sec","job_status":"done","queue_duration_s":0.678737,"scheduling_latency_s":0.678788,"redis_calls":18,"redis_duration_s":0.043197,"redis_read_bytes":20,"redis_write_bytes":4698,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008772,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.002433,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.029557,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002435,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.219281,"completed_at":"2026-09-01T10:39:33.448Z","load_balancing_strategy":"primary","db_duration_s":0.046494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2349gitlab # [ 456.696571] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:33.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b17fcacdf5ef6ebca2933aa4","created_at":"2026-09-01T10:39:32.592Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73c4022466a1c380fef03b0c68ef1aa2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.603Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b17fcacdf5ef6ebca2933aa4: start","job_status":"start","queue_duration_s":0.85501,"scheduling_latency_s":0.855062}2350gitlab # [ 456.760138] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:33.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b17fcacdf5ef6ebca2933aa4","created_at":"2026-09-01T10:39:32.592Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73c4022466a1c380fef03b0c68ef1aa2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.603Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b17fcacdf5ef6ebca2933aa4: done: 0.143822 sec","job_status":"done","queue_duration_s":0.85501,"scheduling_latency_s":0.855062,"redis_calls":9,"redis_duration_s":0.021094,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002511,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009518,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.143822,"completed_at":"2026-09-01T10:39:33.601Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2351gitlab # [ 456.850806] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:33.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"59748efd02ae62141fdea753","created_at":"2026-09-01T10:39:32.617Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2a6927bb075227ef169910fe3ec3408","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.637Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-59748efd02ae62141fdea753: start","job_status":"start","queue_duration_s":0.977066,"scheduling_latency_s":0.978743}2352gitlab # [ 457.251496] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"59748efd02ae62141fdea753","created_at":"2026-09-01T10:39:32.617Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2a6927bb075227ef169910fe3ec3408","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.637Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-59748efd02ae62141fdea753: done: 0.480918 sec","job_status":"done","queue_duration_s":0.977066,"scheduling_latency_s":0.978743,"redis_calls":13,"redis_duration_s":0.0055,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001738,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002042,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00172,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.062,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.379969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00127178,"exclusive_lock_hold_duration_s":0.4217516,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.480918,"completed_at":"2026-09-01T10:39:34.095Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.106479,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2353gitlab # [ 457.359503] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6c13ca57478911fd03bdbe5d","created_at":"2026-09-01T10:39:32.688Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69a10405cfdb32f511218a78ad658923","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.716Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6c13ca57478911fd03bdbe5d: start","job_status":"start","queue_duration_s":1.380733,"scheduling_latency_s":1.380755}2354gitlab # [ 457.382285] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.110Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2355gitlab # [ 457.393255] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6c13ca57478911fd03bdbe5d","created_at":"2026-09-01T10:39:32.688Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69a10405cfdb32f511218a78ad658923","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.716Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6c13ca57478911fd03bdbe5d: done: 0.022712 sec","job_status":"done","queue_duration_s":1.380733,"scheduling_latency_s":1.380755,"redis_calls":9,"redis_duration_s":0.0023810000000000003,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000559,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001276,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022712,"completed_at":"2026-09-01T10:39:34.119Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2356gitlab # [ 457.469528] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"af841f98657beeedfc5b9c0a","created_at":"2026-09-01T10:39:32.744Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8e0b2113ec1dcc5e129572d43d2fc37","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.763Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-af841f98657beeedfc5b9c0a: start","job_status":"start","queue_duration_s":1.360017,"scheduling_latency_s":1.360065}2357gitlab # [ 457.485711] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"af841f98657beeedfc5b9c0a","created_at":"2026-09-01T10:39:32.744Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8e0b2113ec1dcc5e129572d43d2fc37","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.763Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-af841f98657beeedfc5b9c0a: done: 0.091717 sec","job_status":"done","queue_duration_s":1.360017,"scheduling_latency_s":1.360065,"redis_calls":11,"redis_duration_s":0.005637,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000856,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002471,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00231,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00152946,"exclusive_lock_hold_duration_s":0.02656144,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.091717,"completed_at":"2026-09-01T10:39:34.214Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019608,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses2359gitlab # [ 457.531123] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.218Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0ab9902aee2937e1ea038150","created_at":"2026-09-01T10:39:32.779Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36be7077027e8c5080fb22df6a44d80d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.796Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0ab9902aee2937e1ea038150: start","job_status":"start","queue_duration_s":1.421699,"scheduling_latency_s":1.421737}2360gitlab # [ 457.545385] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.273Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0ab9902aee2937e1ea038150","created_at":"2026-09-01T10:39:32.779Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36be7077027e8c5080fb22df6a44d80d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:32.796Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0ab9902aee2937e1ea038150: done: 0.055257 sec","job_status":"done","queue_duration_s":1.421699,"scheduling_latency_s":1.421737,"redis_calls":9,"redis_duration_s":0.004078,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000814,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055257,"completed_at":"2026-09-01T10:39:34.273Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2361gitlab # [ 457.588881] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.276Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6f7d2d5e3c1124ff9dfe2571","created_at":"2026-09-01T10:39:32.859Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3668c087e461c40652b0df2a9fc34c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:39:32.878Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6f7d2d5e3c1124ff9dfe2571: start","job_status":"start","queue_duration_s":1.39778,"scheduling_latency_s":1.397812}2362gitlab # [ 457.601806] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.297Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2363gitlab # [ 457.605082] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6f7d2d5e3c1124ff9dfe2571","created_at":"2026-09-01T10:39:32.859Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3668c087e461c40652b0df2a9fc34c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-01T10:39:32.878Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6f7d2d5e3c1124ff9dfe2571: done: 0.035555 sec","job_status":"done","queue_duration_s":1.39778,"scheduling_latency_s":1.397812,"redis_calls":9,"redis_duration_s":0.002948,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000641,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000661,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035555,"completed_at":"2026-09-01T10:39:34.311Z","load_balancing_strategy":"primary","db_duration_s":0.001017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2364gitlab # [ 457.645472] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"63dbc9612d652e69c2a6ad1a","created_at":"2026-09-01T10:39:33.126Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ac0137b27f7b5fb3063857fda3d4464","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.154Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-63dbc9612d652e69c2a6ad1a: start","job_status":"start","queue_duration_s":1.159405,"scheduling_latency_s":1.159434}2365gitlab # [ 457.659886] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.331Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2366gitlab # [ 457.663368] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"63dbc9612d652e69c2a6ad1a","created_at":"2026-09-01T10:39:33.126Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ac0137b27f7b5fb3063857fda3d4464","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.154Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-63dbc9612d652e69c2a6ad1a: done: 0.028347 sec","job_status":"done","queue_duration_s":1.159405,"scheduling_latency_s":1.159434,"redis_calls":9,"redis_duration_s":0.002538,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028347,"completed_at":"2026-09-01T10:39:34.342Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2367gitlab # [ 457.704628] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.344Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"48c1221df16a341628bc97d4","created_at":"2026-09-01T10:39:33.191Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b3d6c5e650aba8160972d03fd8f2ae5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.211Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-48c1221df16a341628bc97d4: start","job_status":"start","queue_duration_s":1.133022,"scheduling_latency_s":1.133044}2368gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses, in 0.20 seconds)2369gitlab # [ 457.717833] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"48c1221df16a341628bc97d4","created_at":"2026-09-01T10:39:33.191Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b3d6c5e650aba8160972d03fd8f2ae5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.211Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-48c1221df16a341628bc97d4: done: 0.035012 sec","job_status":"done","queue_duration_s":1.133022,"scheduling_latency_s":1.133044,"redis_calls":11,"redis_duration_s":0.003268,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000533,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065786,"exclusive_lock_hold_duration_s":0.00922634,"duration_s":0.035012,"completed_at":"2026-09-01T10:39:34.379Z","load_balancing_strategy":"primary","db_duration_s":0.005169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2370gitlab # [ 457.758077] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5b247697375885d7747849ed","created_at":"2026-09-01T10:39:33.226Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db55c6ee1ee522f8a1ba992ed1b03d7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.276Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5b247697375885d7747849ed: start","job_status":"start","queue_duration_s":1.10447,"scheduling_latency_s":1.104488}2371gitlab # [ 457.772618] gitaly[922]: time="2026-09-01T10:39:34.522Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V215GRD2AQ5VGHM9AXG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:04.419" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:34.521" grpc.time_ms=1.166 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2372gitlab # [ 457.785546] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1282373gitlab # [ 457.788480] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5b247697375885d7747849ed","created_at":"2026-09-01T10:39:33.226Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db55c6ee1ee522f8a1ba992ed1b03d7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.276Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5b247697375885d7747849ed: done: 0.025097 sec","job_status":"done","queue_duration_s":1.10447,"scheduling_latency_s":1.104488,"redis_calls":9,"redis_duration_s":0.0031829999999999996,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002338,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025097,"completed_at":"2026-09-01T10:39:34.405Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2374gitlab # [ 457.830066] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.408Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"47ab8702b723547db5959af2","created_at":"2026-09-01T10:39:33.298Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7fe0ca0fbdc87a1fc48a7425318715e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.317Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-47ab8702b723547db5959af2: start","job_status":"start","queue_duration_s":1.091243,"scheduling_latency_s":1.091268}2375gitlab # [ 457.965222] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"47ab8702b723547db5959af2","created_at":"2026-09-01T10:39:33.298Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7fe0ca0fbdc87a1fc48a7425318715e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.317Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-47ab8702b723547db5959af2: done: 0.400866 sec","job_status":"done","queue_duration_s":1.091243,"scheduling_latency_s":1.091268,"redis_calls":564,"redis_duration_s":0.08359799999999999,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000381,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.082257,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.359231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.400866,"completed_at":"2026-09-01T10:39:34.809Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2376gitlab # [ 458.051011] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a191ebc8231ac7e4155d5c81","created_at":"2026-09-01T10:39:33.329Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5346499125c60bbbfa5410a62a24e89c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.355Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a191ebc8231ac7e4155d5c81: start","job_status":"start","queue_duration_s":1.455667,"scheduling_latency_s":1.455686}2377gitlab # [ 458.068221] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a191ebc8231ac7e4155d5c81","created_at":"2026-09-01T10:39:33.329Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5346499125c60bbbfa5410a62a24e89c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.355Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a191ebc8231ac7e4155d5c81: done: 0.033807 sec","job_status":"done","queue_duration_s":1.455667,"scheduling_latency_s":1.455686,"redis_calls":12,"redis_duration_s":0.003085,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01016948,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.033807,"completed_at":"2026-09-01T10:39:34.844Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004352,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2378gitlab # [ 458.112734] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.846Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0d9c954db203309f83e0c819","created_at":"2026-09-01T10:39:33.309Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-ada78b4ca0dc480f","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.388Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0d9c954db203309f83e0c819: start","job_status":"start","queue_duration_s":1.458104,"scheduling_latency_s":1.458121}2379gitlab # [ 458.124819] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.864Z","message":"No existing merge request to be cleaned up."}2380gitlab # [ 458.126424] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.880Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0d9c954db203309f83e0c819","created_at":"2026-09-01T10:39:33.309Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-ada78b4ca0dc480f","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.388Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0d9c954db203309f83e0c819: done: 0.034182 sec","job_status":"done","queue_duration_s":1.458104,"scheduling_latency_s":1.458121,"redis_calls":12,"redis_duration_s":0.003609,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002028,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034182,"completed_at":"2026-09-01T10:39:34.880Z","load_balancing_strategy":"primary","db_duration_s":0.00665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2381gitlab # [ 458.166351] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.881Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e54739813ebbba2a0a2ae211","created_at":"2026-09-01T10:39:33.309Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-ada78b4ca0dc480f","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.388Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e54739813ebbba2a0a2ae211: start","job_status":"start","queue_duration_s":1.493722,"scheduling_latency_s":1.493738}2382gitlab # [ 458.178449] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.892Z","message":"No existing merge request to be cleaned up."}2383gitlab # [ 458.180085] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.901Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e54739813ebbba2a0a2ae211","created_at":"2026-09-01T10:39:33.309Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-ada78b4ca0dc480f","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.388Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e54739813ebbba2a0a2ae211: done: 0.019659 sec","job_status":"done","queue_duration_s":1.493722,"scheduling_latency_s":1.493738,"redis_calls":10,"redis_duration_s":0.002542,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001494,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019659,"completed_at":"2026-09-01T10:39:34.901Z","load_balancing_strategy":"primary","db_duration_s":0.002476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 458.217524] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.902Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d452a5b3d716bcd46bce712c","created_at":"2026-09-01T10:39:33.309Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-ada78b4ca0dc480f","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.388Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d452a5b3d716bcd46bce712c: start","job_status":"start","queue_duration_s":1.514753,"scheduling_latency_s":1.514768}2385gitlab # [ 458.229556] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.914Z","message":"No existing merge request to be cleaned up."}2386gitlab # [ 458.231169] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.927Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d452a5b3d716bcd46bce712c","created_at":"2026-09-01T10:39:33.309Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-ada78b4ca0dc480f","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.388Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d452a5b3d716bcd46bce712c: done: 0.024987 sec","job_status":"done","queue_duration_s":1.514753,"scheduling_latency_s":1.514768,"redis_calls":10,"redis_duration_s":0.003314,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001425,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024987,"completed_at":"2026-09-01T10:39:34.927Z","load_balancing_strategy":"primary","db_duration_s":0.002487,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2387gitlab # [ 458.269354] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.931Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7d2652a034fac2165f8c7421","created_at":"2026-09-01T10:39:33.309Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-ada78b4ca0dc480f","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.388Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7d2652a034fac2165f8c7421: start","job_status":"start","queue_duration_s":1.543734,"scheduling_latency_s":1.543777}2388gitlab # [ 458.281486] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.959Z","message":"No existing merge request to be cleaned up."}2389gitlab # [ 458.283122] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.979Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7d2652a034fac2165f8c7421","created_at":"2026-09-01T10:39:33.309Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-ada78b4ca0dc480f","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9844a239338fab2ec7a7a2786beb7c8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.388Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7d2652a034fac2165f8c7421: done: 0.048032 sec","job_status":"done","queue_duration_s":1.543734,"scheduling_latency_s":1.543777,"redis_calls":10,"redis_duration_s":0.003718,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002149,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048032,"completed_at":"2026-09-01T10:39:34.979Z","load_balancing_strategy":"primary","db_duration_s":0.002442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 458.320702] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:34.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a415cb687f9f6b3f158f101e","created_at":"2026-09-01T10:39:33.375Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7744c5f1b9a4c5a71e65a293709743b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.395Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a415cb687f9f6b3f158f101e: start","job_status":"start","queue_duration_s":1.586652,"scheduling_latency_s":1.586686}2391gitlab # [ 458.335109] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.060Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a415cb687f9f6b3f158f101e","created_at":"2026-09-01T10:39:33.375Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7744c5f1b9a4c5a71e65a293709743b7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.395Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a415cb687f9f6b3f158f101e: done: 0.078383 sec","job_status":"done","queue_duration_s":1.586652,"scheduling_latency_s":1.586686,"redis_calls":11,"redis_duration_s":0.004421,"redis_read_bytes":9,"redis_write_bytes":1509,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000655,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002198,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001568,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008616,"exclusive_lock_hold_duration_s":0.03757666,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.078383,"completed_at":"2026-09-01T10:39:35.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2392gitlab # [ 458.380070] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7e6a9fc3262378f165bad8f7","created_at":"2026-09-01T10:39:33.439Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e8e4254e9f8d375815b4dbb42003360","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.455Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7e6a9fc3262378f165bad8f7: start","job_status":"start","queue_duration_s":1.608211,"scheduling_latency_s":1.608242}2393gitlab # [ 458.394318] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.084Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2394gitlab # [ 458.397962] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7e6a9fc3262378f165bad8f7","created_at":"2026-09-01T10:39:33.439Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e8e4254e9f8d375815b4dbb42003360","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.455Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7e6a9fc3262378f165bad8f7: done: 0.032356 sec","job_status":"done","queue_duration_s":1.608211,"scheduling_latency_s":1.608242,"redis_calls":9,"redis_duration_s":0.002809,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000638,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001566,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032356,"completed_at":"2026-09-01T10:39:35.095Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2395gitlab # [ 458.439853] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"481e440379bf663c46ba2799","created_at":"2026-09-01T10:39:33.474Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf4631456458ec3b463dd0fe2032d95c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.499Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-481e440379bf663c46ba2799: start","job_status":"start","queue_duration_s":1.598577,"scheduling_latency_s":1.5986}2396gitlab # [ 458.454264] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"481e440379bf663c46ba2799","created_at":"2026-09-01T10:39:33.474Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf4631456458ec3b463dd0fe2032d95c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.499Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-481e440379bf663c46ba2799: done: 0.030328 sec","job_status":"done","queue_duration_s":1.598577,"scheduling_latency_s":1.5986,"redis_calls":11,"redis_duration_s":0.002989,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065786,"exclusive_lock_hold_duration_s":0.00395492,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.030328,"completed_at":"2026-09-01T10:39:35.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2397gitlab # [ 458.496691] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ad39cff8fba60c7d76427355","created_at":"2026-09-01T10:39:33.538Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.569Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ad39cff8fba60c7d76427355: start","job_status":"start","queue_duration_s":1.560231,"scheduling_latency_s":1.560253}2398gitlab # [ 458.510103] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ad39cff8fba60c7d76427355","created_at":"2026-09-01T10:39:33.538Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.569Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ad39cff8fba60c7d76427355: done: 0.119817 sec","job_status":"done","queue_duration_s":1.560231,"scheduling_latency_s":1.560253,"redis_calls":70,"redis_duration_s":0.018182999999999998,"redis_read_bytes":118,"redis_write_bytes":42480,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00247,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000701,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.014247,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.119817,"completed_at":"2026-09-01T10:39:35.249Z","load_balancing_strategy":"primary","db_duration_s":0.002969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2399gitlab # [ 458.552799] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9ee74e885350392cd7d828c1","created_at":"2026-09-01T10:39:33.593Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0890e40e1eef10b63b9ba8525853cc6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.612Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9ee74e885350392cd7d828c1: start","job_status":"start","queue_duration_s":1.639166,"scheduling_latency_s":1.639182}2400gitlab # [ 458.566866] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9ee74e885350392cd7d828c1","created_at":"2026-09-01T10:39:33.593Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-07a6fd06f2c44d15","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0890e40e1eef10b63b9ba8525853cc6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:33.612Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9ee74e885350392cd7d828c1: done: 0.042249 sec","job_status":"done","queue_duration_s":1.639166,"scheduling_latency_s":1.639182,"redis_calls":9,"redis_duration_s":0.002414,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0005,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001394,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.042249,"completed_at":"2026-09-01T10:39:35.293Z","load_balancing_strategy":"primary","db_duration_s":0.019249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401gitlab # [ 458.610472] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7515ff05d9c18570eecae0f9","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7515ff05d9c18570eecae0f9: start","job_status":"start","queue_duration_s":0.05499,"scheduling_latency_s":0.055007}2402gitlab # [ 458.622896] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7515ff05d9c18570eecae0f9","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7515ff05d9c18570eecae0f9: done: 0.024481 sec","job_status":"done","queue_duration_s":0.05499,"scheduling_latency_s":0.055007,"redis_calls":15,"redis_duration_s":0.003523,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024481,"completed_at":"2026-09-01T10:39:35.319Z","load_balancing_strategy":"primary","db_duration_s":0.000704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2403gitlab # [ 458.662933] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d012d5155350ffcfe8eee3dd","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d012d5155350ffcfe8eee3dd: start","job_status":"start","queue_duration_s":0.080884,"scheduling_latency_s":0.0809}2404gitlab # [ 458.675228] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d012d5155350ffcfe8eee3dd","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d012d5155350ffcfe8eee3dd: done: 0.017257 sec","job_status":"done","queue_duration_s":0.080884,"scheduling_latency_s":0.0809,"redis_calls":13,"redis_duration_s":0.0029500000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017257,"completed_at":"2026-09-01T10:39:35.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2405gitlab # [ 458.713559] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ad8eb16be6f3d2387b02b30","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ad8eb16be6f3d2387b02b30: start","job_status":"start","queue_duration_s":0.099636,"scheduling_latency_s":0.099651}2406gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses2407gitlab # [ 458.726302] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ad8eb16be6f3d2387b02b30","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ad8eb16be6f3d2387b02b30: done: 0.016808 sec","job_status":"done","queue_duration_s":0.099636,"scheduling_latency_s":0.099651,"redis_calls":13,"redis_duration_s":0.003335,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002358,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016808,"completed_at":"2026-09-01T10:39:35.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 458.762919] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac3ca27dea0c7a4fa6f95b16","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac3ca27dea0c7a4fa6f95b16: start","job_status":"start","queue_duration_s":0.117771,"scheduling_latency_s":0.117787}2409gitlab # [ 458.775042] nix-daemon[3936]: accepted connection from pid 4623, user nixbot2410gitlab # [ 458.775944] nix-daemon[3936]: accepted connection from pid 4591, user nixbot2411gitlab # [ 458.778246] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac3ca27dea0c7a4fa6f95b16","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac3ca27dea0c7a4fa6f95b16: done: 0.016643 sec","job_status":"done","queue_duration_s":0.117771,"scheduling_latency_s":0.117787,"redis_calls":13,"redis_duration_s":0.003214,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001377,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016643,"completed_at":"2026-09-01T10:39:35.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2412gitlab # [ 458.818658] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a03823ad4f88cb3d861f3d6a","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a03823ad4f88cb3d861f3d6a: start","job_status":"start","queue_duration_s":0.135784,"scheduling_latency_s":0.1358}2413gitlab # [ 458.830970] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a03823ad4f88cb3d861f3d6a","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a03823ad4f88cb3d861f3d6a: done: 0.01708 sec","job_status":"done","queue_duration_s":0.135784,"scheduling_latency_s":0.1358,"redis_calls":13,"redis_duration_s":0.003056,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01708,"completed_at":"2026-09-01T10:39:35.392Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2414gitlab # [ 458.869834] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b905f6661e0b8d2f46a64cf","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b905f6661e0b8d2f46a64cf: start","job_status":"start","queue_duration_s":0.15477,"scheduling_latency_s":0.154787}2415gitlab # [ 458.882255] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b905f6661e0b8d2f46a64cf","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b905f6661e0b8d2f46a64cf: done: 0.016824 sec","job_status":"done","queue_duration_s":0.15477,"scheduling_latency_s":0.154787,"redis_calls":13,"redis_duration_s":0.002859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016824,"completed_at":"2026-09-01T10:39:35.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2416gitlab # [ 458.920300] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1884b344621f474e157fff8c","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1884b344621f474e157fff8c: start","job_status":"start","queue_duration_s":0.174796,"scheduling_latency_s":0.174842}2417gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses, in 0.20 seconds)2418gitlab # [ 458.932836] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1884b344621f474e157fff8c","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1884b344621f474e157fff8c: done: 0.034096 sec","job_status":"done","queue_duration_s":0.174796,"scheduling_latency_s":0.174842,"redis_calls":13,"redis_duration_s":0.0032830000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034096,"completed_at":"2026-09-01T10:39:35.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2419gitlab # [ 458.971356] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ff06285a7668ab740d4e67f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ff06285a7668ab740d4e67f: start","job_status":"start","queue_duration_s":0.210429,"scheduling_latency_s":0.210448}2420gitlab # [ 458.984147] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1112421gitlab # [ 458.987894] gitaly[922]: time="2026-09-01T10:39:35.732Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V37BCV3832JRYPG29NT6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:05.630" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:35.731" grpc.time_ms=1.322 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2422gitlab # [ 459.000601] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ff06285a7668ab740d4e67f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ff06285a7668ab740d4e67f: done: 0.017906 sec","job_status":"done","queue_duration_s":0.210429,"scheduling_latency_s":0.210448,"redis_calls":13,"redis_duration_s":0.00177,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017906,"completed_at":"2026-09-01T10:39:35.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2423gitlab # [ 459.038192] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffc81c531db34cdc08c9ce3b","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffc81c531db34cdc08c9ce3b: start","job_status":"start","queue_duration_s":0.230006,"scheduling_latency_s":0.230035}2424gitlab # [ 459.050101] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffc81c531db34cdc08c9ce3b","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffc81c531db34cdc08c9ce3b: done: 0.019257 sec","job_status":"done","queue_duration_s":0.230006,"scheduling_latency_s":0.230035,"redis_calls":13,"redis_duration_s":0.001865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019257,"completed_at":"2026-09-01T10:39:35.489Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2425gitlab # [ 459.087994] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44e9477c3b97b26ebcf3323f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44e9477c3b97b26ebcf3323f: start","job_status":"start","queue_duration_s":0.250999,"scheduling_latency_s":0.251017}2426gitlab # [ 459.099914] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44e9477c3b97b26ebcf3323f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44e9477c3b97b26ebcf3323f: done: 0.017527 sec","job_status":"done","queue_duration_s":0.250999,"scheduling_latency_s":0.251017,"redis_calls":13,"redis_duration_s":0.002028,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017527,"completed_at":"2026-09-01T10:39:35.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2427gitlab # [ 459.138143] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ec34ab9ab4fe8fa4efd878f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ec34ab9ab4fe8fa4efd878f: start","job_status":"start","queue_duration_s":0.269679,"scheduling_latency_s":0.269696}2428gitlab # [ 459.150341] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ec34ab9ab4fe8fa4efd878f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ec34ab9ab4fe8fa4efd878f: done: 0.017068 sec","job_status":"done","queue_duration_s":0.269679,"scheduling_latency_s":0.269696,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017068,"completed_at":"2026-09-01T10:39:35.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2429gitlab # [ 459.188263] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"021eb3f1282af6c228cdebe5","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-021eb3f1282af6c228cdebe5: start","job_status":"start","queue_duration_s":0.287839,"scheduling_latency_s":0.287855}2430gitlab # [ 459.200931] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"021eb3f1282af6c228cdebe5","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-021eb3f1282af6c228cdebe5: done: 0.01621 sec","job_status":"done","queue_duration_s":0.287839,"scheduling_latency_s":0.287855,"redis_calls":13,"redis_duration_s":0.002055,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001495,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01621,"completed_at":"2026-09-01T10:39:35.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2431gitlab # [ 459.239015] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1b260288fa78e29da2ec0bc","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1b260288fa78e29da2ec0bc: start","job_status":"start","queue_duration_s":0.305161,"scheduling_latency_s":0.305176}2432gitlab # [ 459.251235] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1b260288fa78e29da2ec0bc","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1b260288fa78e29da2ec0bc: done: 0.017274 sec","job_status":"done","queue_duration_s":0.305161,"scheduling_latency_s":0.305176,"redis_calls":13,"redis_duration_s":0.001752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017274,"completed_at":"2026-09-01T10:39:35.562Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2433gitlab # [ 459.289297] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc77f6f88e1fda0866adc4b","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc77f6f88e1fda0866adc4b: start","job_status":"start","queue_duration_s":0.323534,"scheduling_latency_s":0.323551}2434gitlab # [ 459.301389] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc77f6f88e1fda0866adc4b","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc77f6f88e1fda0866adc4b: done: 0.016696 sec","job_status":"done","queue_duration_s":0.323534,"scheduling_latency_s":0.323551,"redis_calls":13,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016696,"completed_at":"2026-09-01T10:39:35.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2435gitlab # [ 459.339663] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e90d52718210296cf278e1f8","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e90d52718210296cf278e1f8: start","job_status":"start","queue_duration_s":0.341367,"scheduling_latency_s":0.341383}2436gitlab # [ 459.351802] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e90d52718210296cf278e1f8","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e90d52718210296cf278e1f8: done: 0.016164 sec","job_status":"done","queue_duration_s":0.341367,"scheduling_latency_s":0.341383,"redis_calls":13,"redis_duration_s":0.00156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016164,"completed_at":"2026-09-01T10:39:35.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2437gitlab # [ 459.389844] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcaaba078cddf33188e8679f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcaaba078cddf33188e8679f: start","job_status":"start","queue_duration_s":0.358969,"scheduling_latency_s":0.358987}2438gitlab # [ 459.402747] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcaaba078cddf33188e8679f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcaaba078cddf33188e8679f: done: 0.015936 sec","job_status":"done","queue_duration_s":0.358969,"scheduling_latency_s":0.358987,"redis_calls":13,"redis_duration_s":0.001573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015936,"completed_at":"2026-09-01T10:39:35.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2439gitlab # [ 459.440292] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e58bade5d62eaa7166df1371","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e58bade5d62eaa7166df1371: start","job_status":"start","queue_duration_s":0.376615,"scheduling_latency_s":0.376632}2440gitlab # [ 459.452238] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e58bade5d62eaa7166df1371","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e58bade5d62eaa7166df1371: done: 0.032336 sec","job_status":"done","queue_duration_s":0.376615,"scheduling_latency_s":0.376632,"redis_calls":13,"redis_duration_s":0.0017360000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032336,"completed_at":"2026-09-01T10:39:35.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2441gitlab # [ 459.489947] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e04a7bec5fedecc20b1443e","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e04a7bec5fedecc20b1443e: start","job_status":"start","queue_duration_s":0.41049,"scheduling_latency_s":0.410508}2442gitlab # [ 459.501830] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e04a7bec5fedecc20b1443e","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e04a7bec5fedecc20b1443e: done: 0.01417 sec","job_status":"done","queue_duration_s":0.41049,"scheduling_latency_s":0.410508,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01417,"completed_at":"2026-09-01T10:39:35.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2443gitlab # [ 459.538972] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5427a0ea7ef13e3d5fbd70a","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5427a0ea7ef13e3d5fbd70a: start","job_status":"start","queue_duration_s":0.425765,"scheduling_latency_s":0.425781}2444gitlab # [ 459.551160] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5427a0ea7ef13e3d5fbd70a","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5427a0ea7ef13e3d5fbd70a: done: 0.014916 sec","job_status":"done","queue_duration_s":0.425765,"scheduling_latency_s":0.425781,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014916,"completed_at":"2026-09-01T10:39:35.680Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2445gitlab # [ 459.588510] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6c7d99f906ed7241d99aa71","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6c7d99f906ed7241d99aa71: start","job_status":"start","queue_duration_s":0.441867,"scheduling_latency_s":0.441885}2446gitlab # [ 459.600245] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6c7d99f906ed7241d99aa71","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6c7d99f906ed7241d99aa71: done: 0.014391 sec","job_status":"done","queue_duration_s":0.441867,"scheduling_latency_s":0.441885,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014391,"completed_at":"2026-09-01T10:39:35.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2447gitlab # [ 459.638494] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09cd8319395292e0cb5f77e5","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09cd8319395292e0cb5f77e5: start","job_status":"start","queue_duration_s":0.457401,"scheduling_latency_s":0.457419}2448gitlab # [ 459.650548] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09cd8319395292e0cb5f77e5","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09cd8319395292e0cb5f77e5: done: 0.014528 sec","job_status":"done","queue_duration_s":0.457401,"scheduling_latency_s":0.457419,"redis_calls":13,"redis_duration_s":0.0016619999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014528,"completed_at":"2026-09-01T10:39:35.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2449gitlab # [ 459.688147] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe1f8154d0222cf40cf04522","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe1f8154d0222cf40cf04522: start","job_status":"start","queue_duration_s":0.473147,"scheduling_latency_s":0.473165}2450gitlab # [ 459.699885] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe1f8154d0222cf40cf04522","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe1f8154d0222cf40cf04522: done: 0.015223 sec","job_status":"done","queue_duration_s":0.473147,"scheduling_latency_s":0.473165,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015223,"completed_at":"2026-09-01T10:39:35.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2451gitlab # [ 459.737476] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bc4746fdce59a6a0871bbe9","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bc4746fdce59a6a0871bbe9: start","job_status":"start","queue_duration_s":0.490285,"scheduling_latency_s":0.490304}2452gitlab # [ 459.749231] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9bc4746fdce59a6a0871bbe9","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9bc4746fdce59a6a0871bbe9: done: 0.017363 sec","job_status":"done","queue_duration_s":0.490285,"scheduling_latency_s":0.490304,"redis_calls":13,"redis_duration_s":0.004497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003694,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017363,"completed_at":"2026-09-01T10:39:35.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2453gitlab # [ 459.786906] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbaef03b9071f42c7a653bbf","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbaef03b9071f42c7a653bbf: start","job_status":"start","queue_duration_s":0.508802,"scheduling_latency_s":0.508819}2454gitlab # [ 459.799457] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbaef03b9071f42c7a653bbf","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbaef03b9071f42c7a653bbf: done: 0.014615 sec","job_status":"done","queue_duration_s":0.508802,"scheduling_latency_s":0.508819,"redis_calls":13,"redis_duration_s":0.001601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014615,"completed_at":"2026-09-01T10:39:35.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2455gitlab # [ 459.838561] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6d16bd77bb11ecd1a354096","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6d16bd77bb11ecd1a354096: start","job_status":"start","queue_duration_s":0.524532,"scheduling_latency_s":0.52455}2456gitlab # [ 459.850779] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6d16bd77bb11ecd1a354096","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6d16bd77bb11ecd1a354096: done: 0.01504 sec","job_status":"done","queue_duration_s":0.524532,"scheduling_latency_s":0.52455,"redis_calls":13,"redis_duration_s":0.001865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001282,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01504,"completed_at":"2026-09-01T10:39:35.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2457gitlab # [ 459.889082] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"614f7e77252d97b5c22fc284","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-614f7e77252d97b5c22fc284: start","job_status":"start","queue_duration_s":0.540702,"scheduling_latency_s":0.54072}2458gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses2459gitlab # [ 459.901290] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"614f7e77252d97b5c22fc284","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-614f7e77252d97b5c22fc284: done: 0.014419 sec","job_status":"done","queue_duration_s":0.540702,"scheduling_latency_s":0.54072,"redis_calls":13,"redis_duration_s":0.0015689999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014419,"completed_at":"2026-09-01T10:39:35.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2460gitlab # [ 459.940044] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e8afef0b7d16e6993df94f0","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e8afef0b7d16e6993df94f0: start","job_status":"start","queue_duration_s":0.556235,"scheduling_latency_s":0.556252}2461gitlab # [ 459.951397] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e8afef0b7d16e6993df94f0","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e8afef0b7d16e6993df94f0: done: 0.014405 sec","job_status":"done","queue_duration_s":0.556235,"scheduling_latency_s":0.556252,"redis_calls":13,"redis_duration_s":0.001466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014405,"completed_at":"2026-09-01T10:39:35.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2462gitlab # [ 459.988198] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c7c5d02c0567cc311e52186","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c7c5d02c0567cc311e52186: start","job_status":"start","queue_duration_s":0.571737,"scheduling_latency_s":0.571753}2463gitlab # [ 460.000487] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c7c5d02c0567cc311e52186","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c7c5d02c0567cc311e52186: done: 0.015764 sec","job_status":"done","queue_duration_s":0.571737,"scheduling_latency_s":0.571753,"redis_calls":13,"redis_duration_s":0.003014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015764,"completed_at":"2026-09-01T10:39:35.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2464gitlab # [ 460.039132] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b97e0db184b2d190005e669e","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b97e0db184b2d190005e669e: start","job_status":"start","queue_duration_s":0.589256,"scheduling_latency_s":0.589275}2465gitlab # [ 460.052208] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b97e0db184b2d190005e669e","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b97e0db184b2d190005e669e: done: 0.028619 sec","job_status":"done","queue_duration_s":0.589256,"scheduling_latency_s":0.589275,"redis_calls":13,"redis_duration_s":0.004876999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003525,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028619,"completed_at":"2026-09-01T10:39:35.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2466gitlab # [ 460.090692] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"903e00338d1145924a2be5eb","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-903e00338d1145924a2be5eb: start","job_status":"start","queue_duration_s":0.620794,"scheduling_latency_s":0.620834}2467gitlab # [ 460.102954] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"903e00338d1145924a2be5eb","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-903e00338d1145924a2be5eb: done: 0.038366 sec","job_status":"done","queue_duration_s":0.620794,"scheduling_latency_s":0.620834,"redis_calls":13,"redis_duration_s":0.005102,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038366,"completed_at":"2026-09-01T10:39:35.899Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2468gitlab # [ 460.141697] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"632c30d61617c0ce68ae6c57","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-632c30d61617c0ce68ae6c57: start","job_status":"start","queue_duration_s":0.661813,"scheduling_latency_s":0.661847}2469gitlab # [ 460.153846] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"632c30d61617c0ce68ae6c57","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-632c30d61617c0ce68ae6c57: done: 0.025161 sec","job_status":"done","queue_duration_s":0.661813,"scheduling_latency_s":0.661847,"redis_calls":13,"redis_duration_s":0.003298,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001154,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025161,"completed_at":"2026-09-01T10:39:35.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2470gitlab # [ 460.192751] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deabf0a28e563606cb5bf671","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deabf0a28e563606cb5bf671: start","job_status":"start","queue_duration_s":0.688797,"scheduling_latency_s":0.68882}2471gitlab # [ 460.205473] gitaly[922]: time="2026-09-01T10:39:36.975Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V4D9Y9NQM62J86M4D7NS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:06.872" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:36.973" grpc.time_ms=1.375 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2472gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses, in 0.29 seconds)2473gitlab # [ 460.218409] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deabf0a28e563606cb5bf671","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deabf0a28e563606cb5bf671: done: 0.019576 sec","job_status":"done","queue_duration_s":0.688797,"scheduling_latency_s":0.68882,"redis_calls":13,"redis_duration_s":0.0030169999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019576,"completed_at":"2026-09-01T10:39:35.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2474gitlab # [ 460.258401] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64284bb8bd3298dbb4dee7fb","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64284bb8bd3298dbb4dee7fb: start","job_status":"start","queue_duration_s":0.709932,"scheduling_latency_s":0.709951}2475gitlab # [ 460.271052] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1812476gitlab # [ 460.273818] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64284bb8bd3298dbb4dee7fb","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64284bb8bd3298dbb4dee7fb: done: 0.017148 sec","job_status":"done","queue_duration_s":0.709932,"scheduling_latency_s":0.709951,"redis_calls":13,"redis_duration_s":0.0030020000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017148,"completed_at":"2026-09-01T10:39:35.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2477gitlab # [ 460.313203] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03650366c176d3401dd13e05","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03650366c176d3401dd13e05: start","job_status":"start","queue_duration_s":0.728503,"scheduling_latency_s":0.72852}2478gitlab # [ 460.325600] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03650366c176d3401dd13e05","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03650366c176d3401dd13e05: done: 0.016424 sec","job_status":"done","queue_duration_s":0.728503,"scheduling_latency_s":0.72852,"redis_calls":13,"redis_duration_s":0.003313,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001358,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016424,"completed_at":"2026-09-01T10:39:35.985Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2479gitlab # [ 460.364333] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:35.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df113f89474f7583099988ff","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df113f89474f7583099988ff: start","job_status":"start","queue_duration_s":0.7464,"scheduling_latency_s":0.746418}2480gitlab # [ 460.376465] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df113f89474f7583099988ff","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df113f89474f7583099988ff: done: 0.015651 sec","job_status":"done","queue_duration_s":0.7464,"scheduling_latency_s":0.746418,"redis_calls":13,"redis_duration_s":0.0027990000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001837,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015651,"completed_at":"2026-09-01T10:39:36.002Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2481gitlab # [ 460.415029] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71d00bee6b312179e2e97a32","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71d00bee6b312179e2e97a32: start","job_status":"start","queue_duration_s":0.763447,"scheduling_latency_s":0.763464}2482gitlab # [ 460.427333] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71d00bee6b312179e2e97a32","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71d00bee6b312179e2e97a32: done: 0.015533 sec","job_status":"done","queue_duration_s":0.763447,"scheduling_latency_s":0.763464,"redis_calls":13,"redis_duration_s":0.002862,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015533,"completed_at":"2026-09-01T10:39:36.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2483gitlab # [ 460.466974] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8842dfba6660c707334b360c","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8842dfba6660c707334b360c: start","job_status":"start","queue_duration_s":0.780404,"scheduling_latency_s":0.780421}2484gitlab # [ 460.479323] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8842dfba6660c707334b360c","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8842dfba6660c707334b360c: done: 0.015354 sec","job_status":"done","queue_duration_s":0.780404,"scheduling_latency_s":0.780421,"redis_calls":13,"redis_duration_s":0.0027530000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001781,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015354,"completed_at":"2026-09-01T10:39:36.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2485gitlab # [ 460.518035] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f7c881bb556341ab89e2d21","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f7c881bb556341ab89e2d21: start","job_status":"start","queue_duration_s":0.797048,"scheduling_latency_s":0.797064}2486gitlab # [ 460.530246] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f7c881bb556341ab89e2d21","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f7c881bb556341ab89e2d21: done: 0.014842 sec","job_status":"done","queue_duration_s":0.797048,"scheduling_latency_s":0.797064,"redis_calls":13,"redis_duration_s":0.002613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001692,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014842,"completed_at":"2026-09-01T10:39:36.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2487gitlab # [ 460.568956] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4403ede5167f0daf12998c71","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4403ede5167f0daf12998c71: start","job_status":"start","queue_duration_s":0.813249,"scheduling_latency_s":0.813266}2488gitlab # [ 460.581230] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4403ede5167f0daf12998c71","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4403ede5167f0daf12998c71: done: 0.01458 sec","job_status":"done","queue_duration_s":0.813249,"scheduling_latency_s":0.813266,"redis_calls":13,"redis_duration_s":0.002571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001693,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01458,"completed_at":"2026-09-01T10:39:36.067Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2489gitlab # [ 460.620211] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abe5d06db0bbe2bd8d51423b","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abe5d06db0bbe2bd8d51423b: start","job_status":"start","queue_duration_s":0.829053,"scheduling_latency_s":0.82907}2490gitlab # [ 460.632416] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abe5d06db0bbe2bd8d51423b","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abe5d06db0bbe2bd8d51423b: done: 0.014475 sec","job_status":"done","queue_duration_s":0.829053,"scheduling_latency_s":0.82907,"redis_calls":13,"redis_duration_s":0.002533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001613,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014475,"completed_at":"2026-09-01T10:39:36.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2491gitlab # [ 460.671906] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"475ec0ff3896dac87864efa0","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-475ec0ff3896dac87864efa0: start","job_status":"start","queue_duration_s":0.844932,"scheduling_latency_s":0.844948}2492gitlab # [ 460.684009] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"475ec0ff3896dac87864efa0","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-475ec0ff3896dac87864efa0: done: 0.014831 sec","job_status":"done","queue_duration_s":0.844932,"scheduling_latency_s":0.844948,"redis_calls":13,"redis_duration_s":0.00273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014831,"completed_at":"2026-09-01T10:39:36.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2493gitlab # [ 460.722517] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daf08e9d705f1e72232cf090","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daf08e9d705f1e72232cf090: start","job_status":"start","queue_duration_s":0.860989,"scheduling_latency_s":0.861004}2494gitlab # [ 460.734985] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daf08e9d705f1e72232cf090","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daf08e9d705f1e72232cf090: done: 0.014508 sec","job_status":"done","queue_duration_s":0.860989,"scheduling_latency_s":0.861004,"redis_calls":13,"redis_duration_s":0.00262,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014508,"completed_at":"2026-09-01T10:39:36.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2495gitlab # [ 460.773523] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d77dba4a929bf73f643ab5e7","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d77dba4a929bf73f643ab5e7: start","job_status":"start","queue_duration_s":0.876892,"scheduling_latency_s":0.87691}2496gitlab # [ 460.785846] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d77dba4a929bf73f643ab5e7","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d77dba4a929bf73f643ab5e7: done: 0.014705 sec","job_status":"done","queue_duration_s":0.876892,"scheduling_latency_s":0.87691,"redis_calls":13,"redis_duration_s":0.0026969999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014705,"completed_at":"2026-09-01T10:39:36.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2497gitlab # [ 460.823838] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77e9e833b6c6745a962b6dac","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77e9e833b6c6745a962b6dac: start","job_status":"start","queue_duration_s":0.892979,"scheduling_latency_s":0.892995}2498gitlab # [ 460.835895] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77e9e833b6c6745a962b6dac","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77e9e833b6c6745a962b6dac: done: 0.014925 sec","job_status":"done","queue_duration_s":0.892979,"scheduling_latency_s":0.892995,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014925,"completed_at":"2026-09-01T10:39:36.148Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2499gitlab # [ 460.875453] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abe593f9d6ef373e3ad0704c","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abe593f9d6ef373e3ad0704c: start","job_status":"start","queue_duration_s":0.909184,"scheduling_latency_s":0.909201}2500gitlab # [ 460.887506] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abe593f9d6ef373e3ad0704c","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abe593f9d6ef373e3ad0704c: done: 0.014684 sec","job_status":"done","queue_duration_s":0.909184,"scheduling_latency_s":0.909201,"redis_calls":13,"redis_duration_s":0.0026290000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014684,"completed_at":"2026-09-01T10:39:36.163Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2501gitlab # [ 460.925557] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9173bb07444ce158f01ae56a","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9173bb07444ce158f01ae56a: start","job_status":"start","queue_duration_s":0.925134,"scheduling_latency_s":0.92515}2502gitlab # [ 460.937667] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9173bb07444ce158f01ae56a","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9173bb07444ce158f01ae56a: done: 0.01549 sec","job_status":"done","queue_duration_s":0.925134,"scheduling_latency_s":0.92515,"redis_calls":13,"redis_duration_s":0.0031349999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01549,"completed_at":"2026-09-01T10:39:36.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2503gitlab # [ 460.975691] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"770faa491b9b2096b8667ce4","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-770faa491b9b2096b8667ce4: start","job_status":"start","queue_duration_s":0.941983,"scheduling_latency_s":0.941999}2504gitlab # [ 460.987647] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"770faa491b9b2096b8667ce4","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-770faa491b9b2096b8667ce4: done: 0.014819 sec","job_status":"done","queue_duration_s":0.941983,"scheduling_latency_s":0.941999,"redis_calls":13,"redis_duration_s":0.002663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014819,"completed_at":"2026-09-01T10:39:36.196Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2505gitlab # [ 461.025143] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c26d505ed826cfd3c424b1f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c26d505ed826cfd3c424b1f: start","job_status":"start","queue_duration_s":0.958236,"scheduling_latency_s":0.958252}2506gitlab # [ 461.037028] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c26d505ed826cfd3c424b1f","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c26d505ed826cfd3c424b1f: done: 0.014817 sec","job_status":"done","queue_duration_s":0.958236,"scheduling_latency_s":0.958252,"redis_calls":13,"redis_duration_s":0.002712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014817,"completed_at":"2026-09-01T10:39:36.213Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2507gitlab # [ 461.074344] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34e41595c9456f6733dab6ff","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34e41595c9456f6733dab6ff: start","job_status":"start","queue_duration_s":0.974384,"scheduling_latency_s":0.974399}2508gitlab # [ 461.086924] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34e41595c9456f6733dab6ff","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34e41595c9456f6733dab6ff: done: 0.014549 sec","job_status":"done","queue_duration_s":0.974384,"scheduling_latency_s":0.974399,"redis_calls":13,"redis_duration_s":0.002638,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014549,"completed_at":"2026-09-01T10:39:36.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2509gitlab # [ 461.124320] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab5f16bf811c05597933163d","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab5f16bf811c05597933163d: start","job_status":"start","queue_duration_s":0.990279,"scheduling_latency_s":0.990295}2510gitlab # [ 461.136133] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:36.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab5f16bf811c05597933163d","created_at":"2026-09-01T10:39:35.155Z","trace_propagation_headers":{"sentry-trace":"86ed540496af42a183844574de8e2655-5cbaabcd4a7a40e6","baggage":"sentry-trace_id=86ed540496af42a183844574de8e2655,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9dd24c78c7bf40dfff9d3a85bd938bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-01T10:39:35.240Z","job_size_bytes":2,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab5f16bf811c05597933163d: done: 0.014863 sec","job_status":"done","queue_duration_s":0.990279,"scheduling_latency_s":0.990295,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014863,"completed_at":"2026-09-01T10:39:36.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2511gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses2512gitlab # [ 461.425647] gitaly[922]: time="2026-09-01T10:39:38.268Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V5NDAN45W70ZFQRRFNJ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:08.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:38.267" grpc.time_ms=1.389 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2513gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses, in 0.26 seconds)2514gitlab # [ 461.480822] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1662515gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses2516gitlab # [ 462.633069] gitaly[922]: time="2026-09-01T10:39:39.476Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V6VJJVG447N1FCZWG9RH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:09.274" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:39.474" grpc.time_ms=1.208 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2517gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses, in 0.20 seconds)2518gitlab # [ 462.679162] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1432519gitlab # [ 463.010595] nix-daemon[3936]: accepted connection from pid 4591, user nixbot2520gitlab # [ 463.181957] gitaly[922]: time="2026-09-01T10:39:40.026Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:10.024" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:40.024" grpc.time_ms=1.234 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2521gitlab # [ 463.265919] gitaly[922]: time="2026-09-01T10:39:40.110Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:50.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:40.092" grpc.time_ms=17.419 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2522gitlab # [ 463.356742] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:40.199Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"10a0f83d6555966425cff493","created_at":"2026-09-01T10:39:40.183Z","trace_propagation_headers":{"sentry-trace":"fd6b1739d6254bf8a2b2ee3443ead4fe-c650a610bb7843f1","baggage":"sentry-trace_id=fd6b1739d6254bf8a2b2ee3443ead4fe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8V7C7P5XB5GT5TY8RVMT1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:40.196Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-10a0f83d6555966425cff493: start","job_status":"start","queue_duration_s":0.002977,"scheduling_latency_s":0.003043}2523gitlab # [ 463.403782] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3222524gitlab # [ 463.411273] nixbot[3708]: {"ts": "2026-09-01T10:39:40.237Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 \"HTTP/1.1 201 Created\""}2525gitlab # [ 463.486452] gitaly[922]: time="2026-09-01T10:39:40.330Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7PN1W6MDNY9XP07AJJ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:10.228" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:40.329" grpc.time_ms=1.272 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2526gitlab # [ 463.571055] gitaly[922]: time="2026-09-01T10:39:40.415Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8V7PN1W6MDNY9XP07AJJ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:50.157" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:40.397" grpc.time_ms=17.524 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2527gitlab # [ 463.596257] gitaly[922]: time="2026-09-01T10:39:40.440Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:40.440" grpc.time_ms=0.679 pid=922 span.kind=server system=grpc2528gitlab # [ 463.637301] gitaly[922]: time="2026-09-01T10:39:40.481Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:40.480" grpc.time_ms=0.649 pid=922 span.kind=server system=grpc2529gitlab # [ 463.662485] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2602530gitlab # [ 463.667454] nixbot[3708]: {"ts": "2026-09-01T10:39:40.508Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 \"HTTP/1.1 201 Created\""}2531gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses2532gitlab # [ 463.675595] gitaly[922]: time="2026-09-01T10:39:40.520Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-01T10:39:40.519" grpc.time_ms=0.82 pid=922 span.kind=server system=grpc2533gitlab # [ 463.697949] gitaly[922]: time="2026-09-01T10:39:40.526Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:40:10.376" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:40.377" operations="[repack_refs]" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2534gitlab # [ 463.716255] gitaly[922]: time="2026-09-01T10:39:40.530Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:40:10.376" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:40.377" pid=922 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-01 10:37:47.07803596 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2535gitlab # [ 463.732975] gitaly[922]: time="2026-09-01T10:39:40.531Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 diskcache=0a0ef3eb-b56e-44d8-a9af-9dd336e02abf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:40:10.376" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:40.377" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2536gitlab # [ 463.746229] gitaly[922]: time="2026-09-01T10:39:40.532Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=149 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7208 command.oublock=0 command.real_time_ms=146 command.spawn_token_fork_ms=1 command.system_time_ms=75 command.user_time_ms=74 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:40:10.376" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:40.377" grpc.time_ms=154.506 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2537gitlab # [ 463.762523] gitaly[922]: time="2026-09-01T10:39:40.573Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:40:10.376" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:40.377" pid=922 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2538gitlab # [ 463.777298] gitaly[922]: time="2026-09-01T10:39:40.573Z" level=info msg="optimized repository" clean_stale_data_time=42.31588ms clean_work_trees_time="135.76µs" commit_graph_time=740ns correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.46µs" pid=922 prune_time=340ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.8µs" storage_name=default system=housekeeping total_time=42.48526ms2539gitlab # [ 463.783212] gitaly[922]: time="2026-09-01T10:39:40.573Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-01T10:40:10.376" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:40.377" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2540gitlab # [ 463.808281] gitaly[922]: time="2026-09-01T10:39:40.652Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7Z993FF8SQ2T5H61319 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:10.051" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:40.651" grpc.time_ms=0.599 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2541gitlab # [ 463.835316] gitaly[922]: time="2026-09-01T10:39:40.679Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-01T10:40:10.678" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:40.678" grpc.time_ms=0.909 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2542gitlab # [ 463.863120] gitaly[922]: time="2026-09-01T10:39:40.707Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1E8V7Z993FF8SQ2T5H61319 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-01T10:39:50.019" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-01T10:39:40.699" grpc.time_ms=7.613 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2543gitlab # [ 463.885090] gitaly[922]: time="2026-09-01T10:39:40.729Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V80RFYZDRBHACQSG7YWT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:10.128" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:40.728" grpc.time_ms=0.644 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2544gitlab # [ 463.900741] gitaly[922]: time="2026-09-01T10:39:40.737Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1E8V7C7P5XB5GT5TY8RVMT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-01T10:40:10.732" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-01T10:39:40.733" grpc.time_ms=4.304 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2545gitlab # [ 463.915144] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:40.758Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ebd4c193bb485bee67bee6ab","created_at":"2026-09-01T10:39:40.754Z","trace_propagation_headers":{"sentry-trace":"fd6b1739d6254bf8a2b2ee3443ead4fe-435c9f4e167a4149","baggage":"sentry-trace_id=fd6b1739d6254bf8a2b2ee3443ead4fe,sentry-release=Unknown"},"correlation_id":"01M1E8V7C7P5XB5GT5TY8RVMT1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"10a0f83d6555966425cff493","job_size_bytes":3,"pid":3646,"job_status":"deduplicated","message":"PipelineProcessWorker JID-ebd4c193bb485bee67bee6ab: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2546gitlab # [ 463.932185] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:40.760Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"10a0f83d6555966425cff493","created_at":"2026-09-01T10:39:40.183Z","trace_propagation_headers":{"sentry-trace":"fd6b1739d6254bf8a2b2ee3443ead4fe-c650a610bb7843f1","baggage":"sentry-trace_id=fd6b1739d6254bf8a2b2ee3443ead4fe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8V7C7P5XB5GT5TY8RVMT1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:40.196Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3646,"job_status":"rescheduled","message":"PipelineProcessWorker JID-10a0f83d6555966425cff493: rescheduled"}2547gitlab # [ 463.948399] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:40.771Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"10a0f83d6555966425cff493","created_at":"2026-09-01T10:39:40.183Z","trace_propagation_headers":{"sentry-trace":"fd6b1739d6254bf8a2b2ee3443ead4fe-c650a610bb7843f1","baggage":"sentry-trace_id=fd6b1739d6254bf8a2b2ee3443ead4fe,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1E8V7C7P5XB5GT5TY8RVMT1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:40.196Z","job_size_bytes":3,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-10a0f83d6555966425cff493: done: 0.572744 sec","job_status":"done","queue_duration_s":0.002977,"scheduling_latency_s":0.003043,"gitaly_calls":3,"gitaly_duration_s":0.176593,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.051846,"redis_read_bytes":239,"redis_write_bytes":21780,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00244,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.004322,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.021874,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.013216,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000578,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002765,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.004211,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.016,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.021,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.282985,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.4951449,"duration_s":0.572744,"completed_at":"2026-09-01T10:39:40.771Z","load_balancing_strategy":"primary","db_duration_s":0.074569,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2548gitlab # [ 463.999865] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/01:10:39:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2522549gitlab # [ 464.002562] nixbot[3708]: {"ts": "2026-09-01T10:39:40.776Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438 \"HTTP/1.1 201 Created\""}2550gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438/statuses, in 0.34 seconds)2551(finished: subtest: eval and build post commit statuses, in 10.12 seconds)2552(finished: run the VM test script, in 535.68 seconds)2553gitlab # [ 464.005415] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:40.773Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"473ae1c31e1cf14a852c74fc","created_at":"2026-09-01T10:39:40.359Z","trace_propagation_headers":{"sentry-trace":"fd6b1739d6254bf8a2b2ee3443ead4fe-435c9f4e167a4149","baggage":"sentry-trace_id=fd6b1739d6254bf8a2b2ee3443ead4fe,sentry-release=Unknown"},"correlation_id":"01M1E8V7C7P5XB5GT5TY8RVMT1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:40.367Z","job_size_bytes":23,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-473ae1c31e1cf14a852c74fc: start","job_status":"start","queue_duration_s":0.406304,"scheduling_latency_s":0.406333}2554test script finished in 535.71s2555cleanup2556kill QemuMachine (pid 46)2557gitlab # [ 464.021041] sidekiq-cluster[3646]: {"severity":"INFO","time":"2026-09-01T10:39:40.822Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"473ae1c31e1cf14a852c74fc","created_at":"2026-09-01T10:39:40.359Z","trace_propagation_headers":{"sentry-trace":"fd6b1739d6254bf8a2b2ee3443ead4fe-435c9f4e167a4149","baggage":"sentry-trace_id=fd6b1739d6254bf8a2b2ee3443ead4fe,sentry-release=Unknown"},"correlation_id":"01M1E8V7C7P5XB5GT5TY8RVMT1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-01T10:39:40.367Z","job_size_bytes":23,"pid":3646,"sidekiq_tid":"m8uu","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-473ae1c31e1cf14a852c74fc: done: 0.049203 sec","job_status":"done","queue_duration_s":0.406304,"scheduling_latency_s":0.406333,"redis_calls":7,"redis_duration_s":0.001145,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_mqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2558gitlab # a2559(finished: cleanup, in 1.84 seconds)2560additionally exposed symbols:2561 gitlab,2562 vlan1,2563 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2564[]2565[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-01T10:37:54.454Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2566[]2567[]2568[]2569[]2570[]2571[]2572[]2573[]2574[]2575[]2576[]2577[]2578[]2579[]2580[]2581[]2582[]2583[]2584[]2585[]2586[]2587[]2588[]2589[]2590[]2591[]2592[]2593[]2594[]2595[]2596[]2597[]2598[]2599[]2600[]2601[]2602[]2603[]2604[]2605[]2606[]2607[]2608[]2609[]2610[]2611[]2612[]2613[]2614[]2615[]2616[]2617[]2618[]2619[]2620[]2621[]2622[]2623[]2624[]2625[]2626[]2627[]2628[]2629[]2630[]2631[]2632[]2633[]2634[]2635[]2636[]2637[]2638[]2639[]2640[]2641[]2642[]2643[]2644[]2645[]2646[]2647[]2648[]2649[]2650[]2651[]2652[]2653[]2654[]2655[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-01T10:39:30.190800Z', 'started_at': '2026-09-01T10:39:30.636227Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2656[{'id': 5, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:30.597Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2657[{'id': 5, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:30.597Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2658[{'id': 5, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:30.597Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2659[{'id': 5, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:30.597Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2660[{'id': 5, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:30.597Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2661[{'id': 5, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:30.597Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2662[{'id': 5, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:30.597Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2663[{'id': 5, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-01T10:39:30.597Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2664[{'id': 5, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-01T10:39:30.597Z', 'started_at': None, 'finished_at': '2026-09-01T10:39:40.163Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '11ed4f15e929acdf8c2c9a96dbd9a1e9f2f9d438', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-01T10:39:40.463Z', 'started_at': None, 'finished_at': '2026-09-01T10:39:40.742Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]