vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #225
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.6Zz0LsmP0F', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 73.00 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 8df1d6f4-76a0-4ef6-9b8f-ca6c4d7a765a19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cgnj6jip55q5wv3lyvdph1z9wrpvkxrc-nixos-system-gitlab-test/init regInfo=/nix/store/b1h97gyi1b88vc1irhy44y9pwi6b2ndn-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/b1h97gyi1b88vc1irhy44y9pwi6b2ndn-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000516] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000705] Console: colour dummy device 80x25110gitlab # [ 0.000712] printk: legacy console [tty0] enabled111gitlab # [ 0.000891] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000898] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000987] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001118] landlock: Up and running.115gitlab # [ 0.001121] Yama: becoming mindful.116gitlab # [ 0.001527] LSM support for eBPF active117gitlab # [ 0.001718] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001816] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003000] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003661] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003665] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003805] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004818] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004913] EFI services will not be available.125gitlab # [ 0.005085] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005694] Detected PIPT I-cache on CPU1127gitlab # [ 0.005793] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005914] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006037] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007082] Detected PIPT I-cache on CPU2131gitlab # [ 0.007188] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007311] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007437] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008479] Detected PIPT I-cache on CPU3135gitlab # [ 0.008595] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008716] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008839] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009340] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009366] SMP: Total of 4 processors activated.140gitlab # [ 0.009369] CPU: All CPU(s) started at EL1141gitlab # [ 0.009378] CPU features: detected: Branch Target Identification142gitlab # [ 0.009382] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009385] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009388] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009392] CPU features: detected: Common not Private translations146gitlab # [ 0.009395] CPU features: detected: CRC32 instructions147gitlab # [ 0.009398] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009401] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009404] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009407] CPU features: detected: E0PD151gitlab # [ 0.009409] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009412] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009416] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009419] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009422] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009427] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009429] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009432] CPU features: detected: Privileged Access Never159gitlab # [ 0.009435] CPU features: detected: PMUv3160gitlab # [ 0.009437] CPU features: detected: RAS Extension Support161gitlab # [ 0.009440] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009443] CPU features: detected: Random Number Generator163gitlab # [ 0.009446] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009448] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009451] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009455] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009577] alternatives: applying system-wide alternatives168gitlab # [ 0.012556] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012774] Memory: 5963764K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014237] devtmpfs: initialized171gitlab # [ 0.018186] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018249] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018445] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018450] 0 pages in range for non-PLT usage175gitlab # [ 0.018451] 508288 pages in range for PLT usage176gitlab # [ 0.018581] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019326] DMI not present or invalid.178gitlab # [ 0.022412] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024775] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025052] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026888] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026912] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027205] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027697] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027700] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027704] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027706] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027709] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027789] cpuidle: using governor ladder190gitlab # [ 0.027813] cpuidle: using governor menu191gitlab # [ 0.028001] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028217] ASID allocator initialised with 65536 entries193gitlab # [ 0.029341] Serial: AMBA PL011 UART driver194gitlab # [ 0.034362] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034681] printk: console [ttyAMA0] enabled196gitlab # [ 0.050674] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.050681] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.050684] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.050687] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.050690] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.050693] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.050696] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.050698] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.063181] fbcon: Taking over console205gitlab # [ 0.063219] ACPI: Interpreter disabled.206gitlab # [ 0.066076] iommu: Default domain type: Translated207gitlab # [ 0.066084] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.079601] SCSI subsystem initialized209gitlab # [ 0.080498] usbcore: registered new interface driver usbfs210gitlab # [ 0.080608] usbcore: registered new interface driver hub211gitlab # [ 0.080684] usbcore: registered new device driver usb212gitlab # [ 0.081499] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.081510] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.081560] PTP clock support registered215gitlab # [ 0.081701] EDAC MC: Ver: 3.0.0216gitlab # [ 0.082229] scmi_core: SCMI protocol bus registered217gitlab # [ 0.083203] FPGA manager framework218gitlab # [ 0.085470] vgaarb: loaded219gitlab # [ 0.087458] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.088060] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.088096] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.088689] netfs: FS-Cache loaded223gitlab # [ 0.088883] pnp: PnP ACPI: disabled224gitlab # [ 0.095619] NET: Registered PF_INET protocol family225gitlab # [ 0.096956] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.133282] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.133342] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.133391] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.133682] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.134309] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.134413] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.134478] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.134608] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.134852] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.134910] NET: Registered PF_XDP protocol family236gitlab # [ 0.134928] PCI: CLS 0 bytes, default 64237gitlab # [ 0.135364] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.147564] kvm [1]: HYP mode not available239gitlab # [ 0.200129] Initialise system trusted keyrings240gitlab # [ 0.200611] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.202417] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.202604] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.241204] Key type asymmetric registered244gitlab # [ 0.241217] Asymmetric key parser 'x509' registered245gitlab # [ 0.241460] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.241734] io scheduler mq-deadline registered247gitlab # [ 0.241747] io scheduler kyber registered248gitlab # [ 0.259154] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.263543] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.264694] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.264751] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.264788] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.264806] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.264845] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.264899] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.265072] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.265091] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.265113] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.265123] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.265133] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.265398] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.266975] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.267684] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.267721] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.267801] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.267839] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.269391] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.270071] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.270107] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.270197] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.271800] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.272423] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.272459] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.272537] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.274081] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.274765] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.274801] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.274892] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.276560] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.277202] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.277236] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.277314] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.278843] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.279523] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.279558] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.279637] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.281145] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.281795] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.281830] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.281911] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.281959] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.283601] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.284258] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.284337] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.285902] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.286524] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.286618] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.287956] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.288585] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.289358] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.290049] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.290085] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.290166] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.291745] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.292365] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.292403] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.292481] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.294307] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.294326] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.294337] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.294472] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.294623] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.294755] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.294889] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.295028] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.295161] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.295309] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.295500] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.295652] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.295840] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.295995] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.296047] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.296099] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.296151] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.296204] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.296267] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.296321] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.296374] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.296430] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.296509] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.296567] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.296622] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.296674] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.296726] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.296778] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.296843] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.296901] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.296955] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.297021] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.297087] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.297141] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.297219] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.297235] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.297244] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.301430] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.329782] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.333720] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.337675] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.342638] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.347252] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.351282] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.356339] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.361355] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.365274] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.370132] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.375488] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.386065] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.390540] msm_serial: driver initialized359gitlab # [ 0.390927] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.391068] STM32 USART driver initialized361gitlab # [ 0.436663] loop: module loaded362gitlab # [ 0.437286] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.442213] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.446834] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.451269] virtio_blk virtio5: [vdb] 12227504 512-byte logical blocks (6.26 GB/5.83 GiB)366gitlab # [ 0.456284] megasas: 07.734.00.00-rc1367gitlab # [ 0.458087] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.463899] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.463931] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.468184] Using buffer write method371gitlab # [ 0.468267] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.474194] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.474226] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.477828] Using buffer write method375gitlab # [ 0.477860] Concatenating MTD devices:376gitlab # [ 0.477866] (0): "0.flash"377gitlab # [ 0.477872] (1): "0.flash"378gitlab # [ 0.477877] into device "0.flash"379gitlab # [ 0.579533] Freeing initrd memory: 27184K380gitlab # [ 0.594767] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.602890] thunder_xcv, ver 1.0382gitlab # [ 0.603003] thunder_bgx, ver 1.0383gitlab # [ 0.603077] nicpf, ver 1.0384gitlab # [ 0.604890] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.604904] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.605021] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.605035] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.605110] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.605119] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.605207] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.605218] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.605692] sky2: driver version 1.30393gitlab # [ 0.610613] usbcore: registered new interface driver usb-storage394gitlab # [ 0.610742] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.610805] ehci-pci 0000:00:0a.0: EHCI Host Controller396gitlab # [ 0.610834] usbserial: USB Serial support registered for generic397gitlab # [ 0.610884] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.611554] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.612817] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.615393] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.615453] rtc-pl031 9010000.pl031: setting system clock to 2026-08-15T23:41:27 UTC (1786837287)402gitlab # [ 0.616469] i2c_dev: i2c /dev entries driver403gitlab # [ 0.625017] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.625030] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.625863] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.627057] sdhci-pltfm: SDHCI platform and OF driver helper407gitlab # [ 0.627576] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00408gitlab # [ 0.628730] hub 1-0:1.0: USB hub found409gitlab # [ 0.628774] hub 1-0:1.0: 6 ports detected410gitlab # [ 0.632170] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.633104] usbcore: registered new interface driver usbhid412gitlab # [ 0.633116] usbhid: USB HID core driver413gitlab # [ 0.657065] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.661757] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.662137] NET: Registered PF_INET6 protocol family416gitlab # [ 0.664542] Segment Routing with IPv6417gitlab # [ 0.664575] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.664645] NET: Registered PF_PACKET protocol family419gitlab # [ 0.665048] 9pnet: Installing 9P2000 support420gitlab # [ 0.669435] Key type dns_resolver registered421gitlab # [ 0.688390] registered taskstats version 1422gitlab # [ 0.688827] Loading compiled-in X.509 certificates423gitlab # [ 0.709800] Demotion targets for Node 0: null424gitlab # [ 0.710022] Key type .fscrypt registered425gitlab # [ 0.710030] Key type fscrypt-provisioning registered426gitlab # [ 0.710207] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.710230] ima: Allocated hash algorithm: sha1428gitlab # [ 0.710259] ima: No architecture policies found429gitlab # [ 0.711342] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.745750] clk: Disabling unused clocks431gitlab # [ 0.745796] PM: genpd: Disabling unused power domains432gitlab # [ 0.754352] Freeing unused kernel memory: 4736K433gitlab # [ 0.754721] Run /init as init process434gitlab # [ 0.798088] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.875553] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.028242] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.116156] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.132857] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.132925] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.133002] systemd[1]: Detected architecture arm64.441gitlab # [ 1.133020] systemd[1]: Running in initrd.442gitlab # [ 1.133850] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.134105] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.235535] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.392347] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2446gitlab # [ 1.393250] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0447gitlab # [ 1.406301] systemd[1]: bpf-restrict-fs: LSM BPF program attached448gitlab # [ 1.503631] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.523737] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.524130] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.524181] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.524201] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.524256] systemd[1]: Reached target Path Units.454gitlab # [ 1.524281] systemd[1]: Reached target Slice Units.455gitlab # [ 1.524309] systemd[1]: Reached target Swaps.456gitlab # [ 1.524336] systemd[1]: Reached target Timer Units.457gitlab # [ 1.524578] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.524833] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.525065] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.525281] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.525408] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.525440] systemd[1]: Reached target Socket Units.463gitlab # [ 1.527896] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.530343] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.530439] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.533044] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.559749] systemd[1]: Starting Journal Service...468gitlab # [ 1.562672] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.562811] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.571666] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.573883] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.575143] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.575634] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.575978] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.577971] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.597807] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.477gitlab # [ 1.603608] systemd[1]: Starting Create Static Device Nodes in /dev...478gitlab # [ 1.614563] systemd-journald[94]: Collecting audit messages is disabled.479gitlab # [ 1.619993] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0480gitlab # [ 1.620281] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.481gitlab # [ 1.620377] [drm] features: -virgl +edid -resource_blob -host_visible482gitlab # [ 1.620385] [drm] features: -context_init483gitlab # [ 1.622217] [drm] number of scanouts: 1484gitlab # [ 1.622244] [drm] number of cap sets: 0485gitlab # [ 1.623656] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev486gitlab # [ 1.627280] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic487gitlab # [ 1.627298] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0488gitlab # [ 1.627999] systemd[1]: Finished Create Static Device Nodes in /dev.489gitlab # [ 1.628152] systemd[1]: Reached target Preparation for Local File Systems.490gitlab # [ 1.628170] systemd[1]: Reached target Local File Systems.491gitlab # [ 1.636905] systemd[1]: Starting Rule-based Manager for Device Events and Files...492gitlab # [ 1.641343] Console: switching to colour frame buffer device 160x50493gitlab # [ 1.648689] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device494gitlab # [ 1.675854] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.678759] systemd[1]: Starting Apply Kernel Variables...496gitlab # [ 1.685475] systemd[1]: Started Journal Service.497gitlab # [ 1.683039] systemd-modules-load[95]: Using 4 probe threads498gitlab # [ 1.686335] systemd-modules-load[95]: Module 'virtio_balloon' is built in499gitlab # [ 1.687446] systemd-modules-load[95]: Module 'virtio_console' is built in500gitlab # [ 1.688589] systemd-modules-load[95]: Module 'virtio_rng' is built in501gitlab # [ 1.691098] systemd-modules-load[95]: Inserted module 'dm_mod'502gitlab # [ 1.692148] systemd-modules-load[95]: Inserted module 'virtio_gpu'503gitlab # [ 1.693188] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.719193] systemd[1]: Finished Create System Files and Directories.505gitlab # [ 1.721153] systemd-udevd[104]: Using default interface naming scheme 'v261'.506gitlab # [ 1.724190] systemd[1]: Finished Apply Kernel Variables.507gitlab # [ 1.741990] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.759017] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.819888] systemd-vconsole-setup[129]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.823287] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.233980] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.236612] systemd[1]: Reached target System Initialization.513gitlab # [ 2.239093] systemd[1]: Reached target Basic System.514gitlab # [ 2.410957] (udev-worker)[135]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.413939] (udev-worker)[135]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.429469] systemd[1]: Found device /dev/disk/by-label/nix-store.517gitlab # [ 2.434322] (udev-worker)[141]: Network interface NamePolicy= disabled on kernel command line.518gitlab # [ 2.444005] systemd[1]: Found device /dev/disk/by-label/nixos.519gitlab # [ 2.446531] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.449015] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.490586] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.497689] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.571960] systemd[1]: Mounting /sysroot...524gitlab # [ 2.608726] EXT4-fs (vda): mounted filesystem 8df1d6f4-76a0-4ef6-9b8f-ca6c4d7a765a r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.608093] systemd[1]: Mounted /sysroot.526gitlab # [ 2.609893] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.614842] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.617769] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.628665] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.634833] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.644287] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.651246] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.666575] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.534gitlab # [ 2.668348] systemd[1]: Mounted /sysroot/nix/.rw-store.535gitlab # [ 2.669162] systemd[1]: Mounted /sysroot/run.536gitlab # [ 2.669826] systemd[1]: Mounted /sysroot/tmp/shared.537gitlab # [ 2.710565] systemd[1]: Starting rw-sysroot-nix-store.service...538gitlab # [ 2.711485] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...539gitlab # [ 2.713323] systemd[1]: Reloading...540gitlab # [ 2.882427] erofs (device vdb): mounted with root inode @ nid 128.541gitlab # [ 2.937610] systemd[1]: Reloading finished in 225 ms.542gitlab # [ 2.989996] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...543gitlab # [ 2.994050] systemd[1]: Mounted /sysroot/nix/.ro-store.544gitlab # [ 2.994854] systemd[1]: Mounted /sysroot/tmp/xchg.545gitlab # [ 2.995541] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.997317] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.998958] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 3.003673] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 3.004830] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 3.008404] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 3.009412] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 3.021449] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 3.022528] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 3.047427] (udev-worker)[143]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 3.050420] (udev-worker)[143]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 3.060057] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 3.061113] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 3.061869] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 3.062643] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.066225] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 3.067298] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 3.068074] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 3.112214] systemd-vconsole-setup[198]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 3.114455] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 3.576503] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 3.645026] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 3.647309] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 3.650048] systemd[1]: Starting Find NixOS closure...569gitlab # [ 3.652399] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 3.702107] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 3.705896] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 3.720930] systemd[1]: Finished Find NixOS closure.573gitlab # [ 3.723228] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 3.725859] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 3.782076] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 3.785193] systemd[1]: Stopped target Basic System.577gitlab # [ 3.787366] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 3.790047] systemd[1]: Stopped target Path Units.579gitlab # [ 3.792381] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 3.795533] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 3.798992] systemd[1]: Stopped target Slice Units.582gitlab # [ 3.801316] systemd[1]: Stopped target Socket Units.583gitlab # [ 3.803532] systemd[1]: Stopped target System Initialization.584gitlab # [ 3.806180] systemd[1]: Stopped target Swaps.585gitlab # [ 3.808164] systemd[1]: Stopped target Timer Units.586gitlab # [ 3.812152] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 3.814702] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 3.817365] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 3.820702] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 3.822918] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 3.826003] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 3.829059] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 3.832285] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 3.834186] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 3.836682] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 3.838203] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 3.840787] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 3.842947] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 3.845431] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 3.847196] systemd[1]: Stopped target Local File Systems.601gitlab # [ 3.848847] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 3.850648] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 3.852486] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 3.853839] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 3.855582] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 3.857406] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 3.858601] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 3.860141] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 3.861603] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.610gitlab # [ 3.863138] systemd[1]: Finished rw-sysroot-nix-store.service.611gitlab # [ 3.864502] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.612gitlab # [ 3.866087] systemd[1]: Finished Load Kernel Module 9pnet_virtio.613gitlab # [ 3.867403] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 3.868962] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 3.870377] systemd[1]: systemd-udevd.service: Consumed 2.270s CPU time over 2.233s wall clock time, 31.5M memory peak.616gitlab # [ 3.872563] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 3.873941] systemd[1]: Closed udev Control Socket.618gitlab # [ 3.874898] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 3.875948] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 3.877499] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 3.878633] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 3.880129] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 3.881419] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 3.882636] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 3.987974] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 3.991475] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 3.993934] systemd[1]: Reached target Switch Root.628gitlab # [ 3.997310] systemd[1]: Starting NixOS Activation...629gitlab # [ 4.214709] initrd-nixos-activation-start[225]: booting system configuration /nix/store/cgnj6jip55q5wv3lyvdph1z9wrpvkxrc-nixos-system-gitlab-test630gitlab # [ 4.291374] initrd-nixos-activation-start[225]: running activation script...631gitlab # [ 4.692555] initrd-nixos-activation-start[248]: setting up /etc...632gitlab # [ 4.909973] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 4.913616] systemd[1]: Finished NixOS Activation.634gitlab # [ 4.915709] systemd[1]: Starting Switch Root...635gitlab # [ 4.977363] systemd[1]: Switching root.636gitlab # [ 5.111201] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 5.776976] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 5.777119] systemd[1]: Detected virtualization qemu.639gitlab # [ 5.777228] systemd[1]: Detected architecture arm64.640gitlab # [ 5.777442] systemd[1]: Detected first boot.641gitlab # [ 5.778891] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 6.007728] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 6.123230] systemd[1]: Applying preset policy.644gitlab # [ 6.348838] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 6.498964] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 6.499211] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 6.500857] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 6.508304] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 6.511188] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 6.515181] systemd[1]: Created slice User and Session Slice.651gitlab # [ 6.515855] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 6.516506] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 6.519263] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 6.520420] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 6.521531] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 6.522655] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 6.523759] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 6.524863] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 6.525967] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 6.527118] systemd[1]: Reached target Path Units.661gitlab # [ 6.528253] systemd[1]: Reached target Remote File Systems.662gitlab # [ 6.529324] systemd[1]: Reached target Slice Units.663gitlab # [ 6.530397] systemd[1]: Reached target Swaps.664gitlab # [ 6.534369] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 6.538537] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 6.541721] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 6.545514] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 6.546882] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 6.556801] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 6.558834] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 6.562916] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 6.564668] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 6.565804] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 6.566854] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 6.573276] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 6.574730] systemd[1]: Listening on udev Control Socket.677gitlab # [ 6.576217] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 6.616439] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 6.622174] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 6.629337] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 6.638674] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 6.645883] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 6.654935] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 6.658817] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 6.671191] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 6.674217] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 6.675268] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 6.691743] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 6.692686] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 6.706364] systemd[1]: Starting Journal Service...691gitlab # [ 6.713722] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 6.727875] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 6.734242] fuse: init (API version 7.45)694gitlab # [ 6.737828] systemd[1]: Starting Remount Root and Kernel File Systems...695gitlab # [ 6.739002] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os696gitlab # [ 6.748102] systemd[1]: Starting Coldplug All udev Devices...697gitlab # [ 6.749239] systemd-journald[319]: Collecting audit messages is enabled.698gitlab # [ 6.769966] systemd[1]: Listening on Journal Log Access Socket.699gitlab # [ 6.771941] systemd[1]: Mounted Huge Pages File System.700gitlab # [ 6.773192] systemd[1]: Mounted POSIX Message Queue File System.701gitlab # [ 6.774387] systemd[1]: Mounted Kernel Debug File System.702gitlab # [ 6.772919] systemd[1]: Queued start job for default target Multi-User System.703gitlab # [ 6.778150] systemd[1]: Mounted Kernel Trace File System.704gitlab # [ 6.779200] systemd[1]: Started Journal Service.705gitlab # [ 6.778887] systemd[1]: Unnecessary job was removed for /dev/vdb.706gitlab # [ 6.781720] systemd[1]: systemd-journald.service: Deactivated successfully.[ 6.785672] EXT4-fs (vda): re-mounted 8df1d6f4-76a0-4ef6-9b8f-ca6c4d7a765a.707gitlab # 708gitlab # [ 6.786734] systemd-modules-load[320]: Using 3 probe threads709gitlab # [ 6.788529] systemd-modules-load[320]: Module 'atkbd' is built in710gitlab # [ 6.790289] systemd-modules-load[320]: Module 'loop' is built in711gitlab # [ 6.791905] systemd[1]: Finished Create List of Static Device Nodes.712gitlab # [ 6.793704] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.713gitlab # [ 6.795558] systemd[1]: Finished Load Kernel Module 9pnet_virtio.714gitlab # [ 6.797276] systemd[1]: Mounted Kernel Configuration File System.715gitlab # [ 6.798765] systemd[1]: modprobe@fuse.service: Deactivated successfully.716gitlab # [ 6.800447] systemd[1]: Finished Load Kernel Module fuse.717gitlab # [ 6.801735] systemd-modules-load[320]: Inserted module 'tls'718gitlab # [ 6.802924] systemd[1]: Finished Load Kernel Modules.719gitlab # [ 6.804030] systemd[1]: Finished Remount Root and Kernel File Systems.720gitlab # [ 6.805381] systemd[1]: Listening on Disk Image Download Service Socket.721gitlab # [ 6.806668] systemd[1]: Mounting FUSE Control File System...722gitlab # [ 6.810166] systemd[1]: Starting Firewall...723gitlab # [ 6.816584] systemd[1]: Starting Flush Journal to Persistent Storage...724gitlab # [ 6.818109] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore725gitlab # [ 6.835521] systemd-oomd[322]: No swap; memory pressure usage will be degraded726gitlab # [ 6.840838] systemd[1]: Starting Load/Save OS Random Seed...727gitlab # [ 6.848176] systemd[1]: Starting Apply Kernel Variables...728gitlab # [ 6.854419] systemd-journald[319]: Received client request to flush runtime journal.729gitlab # [ 6.884697] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...730gitlab # [ 6.886805] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os731gitlab # [ 6.888863] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.732gitlab # [ 6.889903] systemd[1]: Mounted FUSE Control File System.733gitlab # [ 6.890718] systemd[1]: Finished Load/Save OS Random Seed.734gitlab # [ 6.891529] systemd[1]: Reached target First Boot Complete.735gitlab # [ 6.892461] systemd[1]: Finished Apply Kernel Variables.736gitlab # [ 6.893262] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.737gitlab # [ 6.894289] systemd[1]: Finished Flush Journal to Persistent Storage.738gitlab # [ 6.895266] systemd[1]: Starting Create Static Device Nodes in /dev...739gitlab # [ 6.913504] systemd[1]: Finished Create Static Device Nodes in /dev.740gitlab # [ 6.916276] systemd[1]: Reached target Preparation for Local File Systems.741gitlab # [ 6.918358] systemd[1]: Starting Rule-based Manager for Device Events and Files...742gitlab # [ 7.000230] systemd-udevd[368]: Using default interface naming scheme 'v261'.743gitlab # [ 7.037465] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 7.304613] systemd[1]: Finished Firewall.745gitlab # [ 7.395451] systemd[1]: Finished Coldplug All udev Devices.746gitlab # [ 7.474625] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 7.501069] systemd[1]: Mounting /run/wrappers...748gitlab # [ 7.542190] systemd[1]: Mounted /run/wrappers.749gitlab # [ 7.556241] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.750gitlab # [ 7.566545] systemd[1]: Reached target Local File Systems.751gitlab # [ 7.573133] systemd[1]: Listening on Boot Loader Control Service Socket.752gitlab # [ 7.578529] (udev-worker)[474]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.753gitlab # [ 7.583035] (udev-worker)[474]: Network interface NamePolicy= disabled on kernel command line.754gitlab # [ 7.585294] systemd[1]: Starting register-nix-paths.service...755gitlab # [ 7.592743] systemd[1]: Starting Create SUID/SGID Wrappers...756gitlab # [ 7.594421] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.757gitlab # [ 7.598132] systemd[1]: Starting Save Transient machine-id to Disk...758gitlab # [ 7.608054] systemd[1]: Starting Create System Files and Directories...759gitlab # [ 7.609819] systemd[1]: Condition check resulted in Virtio network device being skipped.760gitlab # [ 7.611806] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore761gitlab # [ 7.618830] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.762gitlab # [ 7.621676] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67763gitlab # [ 7.627270] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore764gitlab # [ 7.632232] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os765gitlab # [ 7.635336] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os766gitlab # [ 7.674745] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.767gitlab # [ 7.676811] systemd[1]: Finished Save Transient machine-id to Disk.768gitlab # [ 7.681108] systemd[1]: Finished Create System Files and Directories.769gitlab # [ 7.682686] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.770gitlab # [ 7.688481] systemd[1]: Starting Rebuild Journal Catalog...771gitlab # [ 7.689817] systemd[1]: Starting Record System Boot/Shutdown in UTMP...772gitlab # [ 7.721825] systemd[1]: Finished Record System Boot/Shutdown in UTMP.773gitlab # [ 7.737472] systemd[1]: Finished Rebuild Journal Catalog.774gitlab # [ 7.740213] systemd[1]: Starting Update is Completed...775gitlab # [ 7.767296] systemd[1]: Finished Update is Completed.776gitlab # [ 7.781910] mousedev: PS/2 mouse device common for all mice777gitlab # [ 7.794083] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.778gitlab # [ 7.795217] systemd[1]: Finished Create SUID/SGID Wrappers.779gitlab # [ 7.796112] systemd[1]: suid-sgid-wrappers.service: Consumed 138ms CPU time over 201ms wall clock time, 6.6M memory peak, 1.9M read from disk.780gitlab # [ 8.045219] systemd[1]: Finished register-nix-paths.service.781gitlab # [ 8.047737] systemd[1]: Reached target System Initialization.782gitlab # [ 8.048775] systemd[1]: Started Discard unused filesystem blocks once a week.783gitlab # [ 8.049788] systemd[1]: Started logrotate.timer.784gitlab # [ 8.050488] systemd[1]: Started Daily Cleanup of Temporary Directories.785gitlab # [ 8.051434] systemd[1]: Reached target Timer Units.786gitlab # [ 8.053799] systemd[1]: Listening on D-Bus System Message Bus Socket.787gitlab # [ 8.054776] systemd[1]: Listening on Nix Daemon Socket.788gitlab # [ 8.065917] systemd[1]: Starting nixbot CI service socket...789gitlab # [ 8.066899] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.790gitlab # [ 8.068250] systemd[1]: Listening on nixbot CI service socket.791gitlab # [ 8.069151] systemd[1]: Reached target Socket Units.792gitlab # [ 8.070976] systemd[1]: Starting D-Bus System Message Bus...793gitlab # [ 8.108579] dbus-broker-launch[563]: Looking up NSS user entry for 'systemd-timesync'...794gitlab # [ 8.110805] dbus-broker-launch[563]: NSS returned no entry for 'systemd-timesync'795gitlab # [ 8.112215] dbus-broker-launch[563]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"796gitlab # [ 8.116844] systemd[1]: Started D-Bus System Message Bus.797gitlab # [ 8.128742] dbus-broker-launch[563]: Ready798gitlab # [ 8.131360] systemd[1]: Reached target Basic System.799gitlab # [ 8.133243] systemd[1]: Started backdoor.service.800gitlab # [ 8.139331] systemd[1]: Starting gitlab-config.service...801gitlab # [ 8.142623] systemd[1]: Starting Import lastlog data into lastlog2 database...802gitlab # [ 8.164727] systemd[1]: Starting Logrotate configuration check...803gitlab # [ 8.170106] systemd[1]: Starting Name Service Cache Daemon (nsncd)...804gitlab # [ 8.175044] systemd[1]: Starting Post-Boot Actions...805gitlab # [ 8.184294] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3806gitlab # [ 8.183936] logrotate[570]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.807gitlab # [ 8.188584] logrotate[570]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf808gitlab # [ 8.192097] logrotate[570]: note: 'monthly' overrides previously specified 'weekly'809gitlab # [ 8.193569] logrotate[570]: Reading state from file: /var/lib/logrotate.status810gitlab # [ 8.198689] logrotate[570]: state file /var/lib/logrotate.status does not exist811gitlab # [ 8.199781] logrotate[570]: Allocating hash table for state file, size 64 entries812gitlab # connecting to host...813gitlab # [ 8.201462] logrotate[570]: Handling 4 logs814gitlab # [ 8.202328] logrotate[570]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed815gitlab # [ 8.206396] logrotate[570]: considering log /var/log/btmp816gitlab # [ 8.207137] logrotate[570]: Creating new state817gitlab # [ 8.208339] logrotate[570]: Now: 2026-08-15 23:41818gitlab # [ 8.212984] logrotate[570]: Last rotated at 2026-08-15 23:00819gitlab: Guest shell says: b'Spawning backdoor root shell...\n'820gitlab # [ 8.217560] logrotate[570]: log does not need rotating (log has already been rotated)821gitlab # [ 8.218687] logrotate[570]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed822gitlab # [ 8.220863] logrotate[570]: considering log /var/log/wtmp823gitlab # [ 8.221533] logrotate[570]: Creating new state824gitlab: connected to guest root shell825gitlab # [ 8.222097] logrotate[570]: Now: 2026-08-15 23:41826gitlab: (connecting took 8.66 seconds)827gitlab # [ 8.222713] logrotate[570]: Last rotated at 2026-08-15 23:00828gitlab: (finished: waiting for the VM to finish booting, in 8.67 seconds)829gitlab # [ 8.223471] logrotate[570]: log does not need rotating (log has already been rotated)830gitlab # [ 8.227601] logrotate[570]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed831gitlab # [ 8.229448] logrotate[570]: switching euid from 0 to 165 and egid from 0 to 165 (pid 570)832gitlab # [ 8.230453] logrotate[570]: considering log /var/gitlab/state/log/*.log833gitlab # [ 8.231320] logrotate[570]: log /var/gitlab/state/log/*.log does not exist -- skipping834gitlab # [ 8.233984] logrotate[570]: Creating new state835gitlab # [ 8.234555] logrotate[570]: switching euid from 165 to 0 and egid from 165 to 0 (pid 570)836gitlab # [ 8.235513] logrotate[570]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed837gitlab # [ 8.237245] logrotate[570]: switching euid from 0 to 60 and egid from 0 to 60 (pid 570)838gitlab # [ 8.238264] logrotate[570]: considering log /var/log/nginx/*.log839gitlab # [ 8.239067] logrotate[570]: log /var/log/nginx/*.log does not exist -- skipping840gitlab # [ 8.242153] logrotate[570]: Creating new state841gitlab # [ 8.242806] logrotate[570]: not running postrotate script, since no logs were rotated842gitlab # [ 8.243824] logrotate[570]: switching euid from 60 to 0 and egid from 60 to 0 (pid 570)843gitlab # [ 8.245607] systemd[1]: Started Reset console on configuration changes.844gitlab # [ 8.248284] systemd[1]: Starting resolvconf update...845gitlab # [ 8.249215] systemd[1]: Finished Logrotate configuration check.846gitlab # [ 8.250125] systemd[1]: Finished Post-Boot Actions.847gitlab # [ 8.251753] systemd[1]: Started Name Service Cache Daemon (nsncd).848gitlab # [ 8.254682] nsncd[571]: Aug 15 23:41:35.120 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"849gitlab # [ 8.258862] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 8.260747] systemd[1]: Reached target Host and Network Name Lookups.851gitlab # [ 8.261822] systemd[1]: Reached target User and Group Name Lookups.852gitlab # [ 8.265656] systemd[1]: Starting User Login Management...853gitlab # [ 8.326084] systemd[1]: Stopped target Host and Network Name Lookups.854gitlab # [ 8.327074] systemd[1]: Stopping Host and Network Name Lookups...855gitlab # [ 8.327946] systemd[1]: Stopped target User and Group Name Lookups.856gitlab # [ 8.334063] systemd[1]: Stopping User and Group Name Lookups...857gitlab # [ 8.334979] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...858gitlab # [ 8.335909] systemd[1]: Starting Virtual Console Setup...859gitlab # [ 8.336764] systemd[1]: nscd.service: Deactivated successfully.860gitlab # [ 8.337611] systemd[1]: Stopped Name Service Cache Daemon (nsncd).861gitlab # [ 8.338446] systemd[1]: nscd.service: Consumed 24ms CPU time over 159ms wall clock time, 7.3M memory peak, 5.8M read from disk.862gitlab # [ 8.348498] systemd[1]: Starting Name Service Cache Daemon (nsncd)...863gitlab # [ 8.368408] systemd-logind[619]: New seat seat0.864gitlab # [ 8.371704] systemd-logind[619]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)865gitlab # [ 8.374629] systemd-logind[619]: Watching system buttons on /dev/input/event0 (gpio-keys)866gitlab # [ 8.376460] nsncd[668]: Aug 15 23:41:35.261 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"867gitlab # [ 8.379306] systemd[1]: Started Name Service Cache Daemon (nsncd).868gitlab # [ 8.380444] systemd[1]: Started User Login Management.869gitlab # [ 8.381175] systemd[1]: Finished resolvconf update.870gitlab # [ 8.381891] systemd[1]: Reached target Preparation for Network.871gitlab # [ 8.382927] systemd[1]: Reached target Host and Network Name Lookups.872gitlab # [ 8.383821] systemd[1]: Reached target User and Group Name Lookups.873gitlab # [ 8.386251] systemd-logind[619]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)874gitlab # [ 8.387855] systemd[1]: Starting DHCP Client...875gitlab # [ 8.392575] systemd[1]: Starting linger-users.service...876gitlab # [ 8.406789] systemd[1]: Starting Address configuration of eth1...877gitlab # [ 8.411006] systemd-vconsole-setup[656]: Configuration of first virtual console was skipped, ignoring remaining ones.878gitlab # [ 8.412712] systemd[1]: Starting Extra networking commands....879gitlab # [ 8.417044] systemd[1]: Finished Virtual Console Setup.880gitlab # [ 8.419003] systemd[1]: linger-users.service: Deactivated successfully.881gitlab # [ 8.419926] systemd[1]: Finished linger-users.service.882gitlab # [ 8.438775] network-addresses-eth1-start[691]: adding address 192.168.1.1/24... done883gitlab # [ 8.442260] network-addresses-eth1-start[691]: adding address 2001:db8:1::1/64... done884gitlab # [ 8.449019] systemd[1]: Finished Address configuration of eth1.885gitlab # [ 8.497967] systemd[1]: Finished Extra networking commands..886gitlab # [ 8.498854] systemd[1]: Reached target Network.887gitlab # [ 8.504089] systemd[1]: Starting gitlab-workhorse.service...888gitlab # [ 8.505399] dhcpcd[711]: dhcpcd-10.3.2 starting889gitlab # [ 8.506089] systemd[1]: Starting Nginx Web Server...890gitlab # [ 8.507039] dhcpcd[760]: dev: loaded udev891gitlab # [ 8.510181] systemd[1]: Starting PostgreSQL Server...892gitlab # [ 8.513572] systemd[1]: Starting Redis Server - redis-gitlab...893gitlab # [ 8.524290] 8021q: 802.1Q VLAN Support v1.8894gitlab # [ 8.524685] 8021q: adding VLAN 0 to HW filter on device eth1895gitlab # [ 8.521606] systemd[1]: Starting Permit User Sessions...896gitlab # [ 8.534262] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.897gitlab # [ 8.567299] cfg80211: Loading compiled-in X.509 certificates for regulatory database898gitlab # [ 8.567589] systemd[1]: Finished Permit User Sessions.899gitlab # [ 8.568940] systemd[1]: Started Getty on tty1.900gitlab # [ 8.569611] systemd[1]: Reached target Login Prompts.901gitlab # [ 8.586070] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'902gitlab # [ 8.586563] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'903gitlab # [ 8.588261] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2904gitlab # [ 8.588576] cfg80211: failed to load regulatory.db905gitlab # [ 8.620933] 8021q: adding VLAN 0 to HW filter on device eth0906gitlab # [ 8.619452] dhcpcd[760]: eth0: waiting for carrier907gitlab # [ 8.620536] dhcpcd[760]: eth0: carrier acquired908gitlab # [ 8.625048] dhcpcd[760]: DUID 00:01:00:01:32:13:b5:af:52:54:00:12:34:56909gitlab # [ 8.626081] dhcpcd[760]: eth0: IAID 00:12:34:56910gitlab # [ 8.626764] dhcpcd[760]: eth0: adding address fe80::5054:ff:fe12:3456911gitlab # [ 8.684404] nginx-pre-start[797]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok912gitlab # [ 8.686391] nginx-pre-start[797]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful913gitlab # [ 8.692464] systemd[1]: Started Nginx Web Server.914gitlab # [ 8.707790] postgresql-pre-start[795]: The files belonging to this database system will be owned by user "postgres".915gitlab # [ 8.710108] postgresql-pre-start[795]: This user must also own the server process.916gitlab # [ 8.711496] postgresql-pre-start[795]: The database cluster will be initialized with locale "en_US.UTF-8".917gitlab # [ 8.712863] postgresql-pre-start[795]: The default database encoding has accordingly been set to "UTF8".918gitlab # [ 8.714363] postgresql-pre-start[795]: The default text search configuration will be set to "english".919gitlab # [ 8.715747] postgresql-pre-start[795]: Data page checksums are enabled.920gitlab # [ 8.716869] postgresql-pre-start[795]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok921gitlab # [ 8.718265] postgresql-pre-start[795]: creating subdirectories ... ok922gitlab # [ 8.719240] postgresql-pre-start[795]: selecting dynamic shared memory implementation ... posix923gitlab # [ 8.720798] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.924gitlab # [ 8.722941] systemd[1]: Started Redis Server - redis-gitlab.925gitlab # [ 8.723707] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo926gitlab # [ 8.725201] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started927gitlab # [ 8.726789] redis-server[789]: Configuration loaded928gitlab # [ 8.727801] redis[789]: monotonic clock: ARM CNTVCT @ 1000 ticks/us929gitlab # [ 8.728925] redis[789]: Running mode=standalone, port=0.930gitlab # [ 8.729835] redis[789]: Server initialized931gitlab # [ 8.730537] redis[789]: Ready to accept connections unix932gitlab # [ 8.731574] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.933gitlab # [ 8.764210] postgresql-pre-start[795]: selecting default "max_connections" ... 100934gitlab # [ 8.815508] postgresql-pre-start[795]: selecting default "shared_buffers" ... 128MB935gitlab # [ 9.118267] systemd[1]: Started gitlab-workhorse.service.936gitlab # [ 9.279771] postgresql-pre-start[795]: selecting default time zone ... UTC937gitlab # [ 9.283071] postgresql-pre-start[795]: creating configuration files ... ok938gitlab # [ 9.329173] gitlab-workhorse[820]: time="2026-08-15T23:41:36Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4939gitlab # [ 9.331586] gitlab-workhorse[820]: time="2026-08-15T23:41:36Z" level=info msg="Using redis/go-redis"940gitlab # [ 9.333647] gitlab-workhorse[820]: time="2026-08-15T23:41:36Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix941gitlab # [ 9.345720] dhcpcd[760]: eth0: soliciting a DHCP lease942gitlab # [ 9.360604] dhcpcd[760]: eth0: offered 10.0.2.15 from 10.0.2.2943gitlab # [ 9.380390] dhcpcd[760]: eth0: probing address 10.0.2.15/24944gitlab # [ 9.586674] postgresql-pre-start[795]: running bootstrap script ... ok945gitlab # [ 10.247067] postgresql-pre-start[795]: performing post-bootstrap initialization ... ok946gitlab # [ 10.510142] postgresql-pre-start[795]: syncing data to disk ... ok947gitlab # [ 10.512733] postgresql-pre-start[795]: initdb: warning: enabling "trust" authentication for local connections948gitlab # [ 10.516321] postgresql-pre-start[795]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.949gitlab # [ 10.521917] postgresql-pre-start[795]: Success. You can now start the database server using:950gitlab # [ 10.525016] postgresql-pre-start[795]: pg_ctl -D /var/lib/postgresql/18 -l logfile start951gitlab # [ 10.694321] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit952gitlab # [ 10.699816] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432953gitlab # [ 10.703181] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432954gitlab # [ 10.706526] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"955gitlab # [ 10.715521] postgres[863]: [863] LOG: database system was shut down at 2026-08-15 23:41:37 GMT956gitlab # [ 10.727097] postgres[854]: [854] LOG: database system is ready to accept connections957gitlab # [ 10.735183] systemd[1]: Started PostgreSQL Server.958gitlab # [ 10.744726] systemd[1]: Starting PostgreSQL Setup Scripts...959gitlab # [ 11.045096] dhcpcd[760]: eth0: soliciting an IPv6 router960gitlab # [ 11.047301] dhcpcd[760]: eth0: Router Advertisement from fe80::2961gitlab # [ 11.049688] dhcpcd[760]: eth0: adding address fec0::5054:ff:fe12:3456/64962gitlab # [ 11.052215] dhcpcd[760]: eth0: adding route to fec0::/64963gitlab # [ 11.054204] dhcpcd[760]: eth0: adding default route via fe80::2964gitlab # [ 11.191685] postgresql-setup-start[874]: CREATE DATABASE965gitlab # [ 11.254066] postgresql-setup-start[884]: CREATE ROLE966gitlab # [ 11.281302] postgresql-setup-start[886]: ALTER DATABASE967gitlab # [ 11.298917] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[879]: mkdir -p /var/gitlab/state/home/.ssh: OK968gitlab # [ 11.303346] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[879]: chmod 700 /var/gitlab/state/home/.ssh: OK969gitlab # [ 11.341536] postgresql-setup-start[895]: CREATE ROLE970gitlab # [ 11.345985] systemd[1]: Finished PostgreSQL Setup Scripts.971gitlab # [ 11.348323] systemd[1]: Reached target PostgreSQL.972gitlab # [ 11.351972] systemd[1]: Starting gitlab-postgresql.service...973gitlab # [ 11.402008] systemd[1]: Finished gitlab-config.service.974gitlab # [ 11.409303] systemd[1]: Started gitaly.service.975gitlab # [ 11.416236] systemd[1]: Starting gitlab-db-config.service...976gitlab # [ 11.552727] gitlab-postgresql-start[913]: CREATE DATABASE977gitlab # [ 11.617258] gitlab-postgresql-start[929]: CREATE EXTENSION978gitlab # [ 11.732336] gitlab-postgresql-start[932]: CREATE EXTENSION979gitlab # [ 11.737474] systemd[1]: Finished gitlab-postgresql.service.980gitlab # [ 12.003228] gitaly[910]: time="2026-08-15T23:41:38.889Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=910981gitlab # [ 12.015175] gitaly[910]: time="2026-08-15T23:41:38.890Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=910982gitlab # [ 12.020146] gitaly[910]: time="2026-08-15T23:41:38.890Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=910983gitlab # [ 12.026378] gitaly[910]: time="2026-08-15T23:41:38.890Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=910984gitlab # [ 12.031997] gitaly[910]: time="2026-08-15T23:41:38.890Z" level=info msg="Starting Gitaly" pid=910 version=985gitlab # [ 12.208105] gitaly[910]: time="2026-08-15T23:41:39.095Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=205 pid=910986gitlab # [ 12.210490] gitaly[910]: time="2026-08-15T23:41:39.096Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=910987gitlab # [ 12.212636] gitaly[910]: time="2026-08-15T23:41:39.096Z" level=info msg="finished initializing command factory" duration_ms=0 pid=910988gitlab # [ 12.214728] gitaly[910]: time="2026-08-15T23:41:39.096Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-910/git-exec-4061836358.d/git pid=910989gitlab # [ 12.217315] gitaly[910]: time="2026-08-15T23:41:39.101Z" level=info msg="finished detecting git version" duration_ms=4 pid=910990gitlab # [ 12.219258] gitaly[910]: time="2026-08-15T23:41:39.101Z" level=info msg="using Git version" pid=910 version=2.53.g991gitlab # [ 12.221155] gitaly[910]: time="2026-08-15T23:41:39.101Z" level=info msg="clearing disk cache object folder" pid=910 storage=default992gitlab # [ 12.223162] gitaly[910]: time="2026-08-15T23:41:39.101Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2429715440 pid=910 storage=default993gitlab # [ 12.226513] gitaly[910]: time="2026-08-15T23:41:39.101Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2429715440 pid=910 storage=default994gitlab # [ 12.230599] gitaly[910]: time="2026-08-15T23:41:39.101Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=910995gitlab # [ 12.233800] gitaly[910]: time="2026-08-15T23:41:39.101Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=910996gitlab # [ 12.236939] gitaly[910]: time="2026-08-15T23:41:39.102Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2429715440 clear_duration_ms=0 pid=910 storage=default997gitlab # [ 12.240214] gitaly[910]: time="2026-08-15T23:41:39.117Z" level=info msg="counting repositories" pid=910998gitlab # [ 12.241737] gitaly[910]: time="2026-08-15T23:41:39.117Z" level=info msg="starting to count repositories" pid=910 storage_path=/var/gitlab/state/repositories999gitlab # [ 12.243906] gitaly[910]: time="2026-08-15T23:41:39.117Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=910 storage_path=/var/gitlab/state/repositories1000gitlab # [ 12.246775] gitaly[910]: time="2026-08-15T23:41:39.117Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9101001gitlab # [ 12.248700] gitaly[910]: time="2026-08-15T23:41:39.117Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9101002gitlab # [ 12.250950] gitaly[910]: time="2026-08-15T23:41:39.117Z" level=info msg="finished tempdir cleaner walk" pid=910 storage=default time_ms=01003gitlab # [ 12.252856] gitaly[910]: time="2026-08-15T23:41:39.117Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=910 schema=unix1004gitlab # [ 12.254880] gitaly[910]: time="2026-08-15T23:41:39.118Z" level=info msg="listening at address" address=/run/gitaly/gitaly-910/sock.d/intern pid=910 schema=unix1005gitlab # [ 12.256957] gitaly[910]: time="2026-08-15T23:41:39.119Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9101006gitlab # [ 12.258617] gitaly[910]: time="2026-08-15T23:41:39.119Z" level=info msg="Started Gitaly" duration_ms=229 pid=9101007gitlab # [ 12.260029] gitaly[910]: time="2026-08-15T23:41:39.119Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9101008gitlab # [ 12.261661] gitaly[910]: time="2026-08-15T23:41:39.119Z" level=info msg="maintenance: daily scheduled" pid=910 scheduled="2026-08-16 12:00:00 +0000 UTC"1009gitlab # [ 12.805648] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1010gitlab # [ 12.810184] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1011gitlab # [ 12.824913] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1012gitlab # [ 13.956195] dhcpcd[760]: eth0: leased 10.0.2.15 for 86400 seconds1013gitlab # [ 13.959367] dhcpcd[760]: eth0: adding route to 10.0.2.0/241014gitlab # [ 13.961824] dhcpcd[760]: eth0: adding default route via 10.0.2.21015gitlab # [ 14.092533] systemd[1]: Started DHCP Client.1016gitlab # [ 14.093355] systemd[1]: Reached target Network is Online.1017gitlab # [ 15.634067] gitaly[910]: time="2026-08-15T23:41:42.520Z" level=info msg="License database preloaded" duration_ms=3630 pid=9101018gitlab # [ 57.212168] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[916]: W, [2026-08-15T23:42:24.098575 #916] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1019gitlab # [ 59.410776] gitlab-workhorse[820]: time="2026-08-15T23:42:26Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1020gitlab # [ 60.320404] postgres[1430]: [1430] ERROR: relation "feature_gates" does not exist at character 5231021gitlab # [ 60.324235] postgres[1430]: [1430] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1022gitlab # [ 60.327845] postgres[1430]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1023gitlab # [ 60.331760] postgres[1430]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1024gitlab # [ 60.335343] postgres[1430]: attidentity AS identity,1025gitlab # [ 60.337787] postgres[1430]: attgenerated as attgenerated1026gitlab # [ 60.340325] postgres[1430]: FROM pg_attribute a1027gitlab # [ 60.342341] postgres[1430]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1028gitlab # [ 60.346074] postgres[1430]: LEFT JOIN pg_type t ON a.atttypid = t.oid1029gitlab # [ 60.348832] postgres[1430]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1030gitlab # [ 60.353123] postgres[1430]: WHERE a.attrelid = '"feature_gates"'::regclass1031gitlab # [ 60.355910] postgres[1430]: AND a.attnum > 0 AND NOT a.attisdropped1032gitlab # [ 60.358761] postgres[1430]: ORDER BY a.attnum1033gitlab # [ 60.360864] postgres[1430]:1034gitlab # [ 65.438988] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1481]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1035gitlab # [ 65.444661] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1481]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1036gitlab # [ 69.418985] gitlab-workhorse[820]: time="2026-08-15T23:42:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1037gitlab # [ 79.420363] gitlab-workhorse[820]: time="2026-08-15T23:42:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 89.430059] gitlab-workhorse[820]: time="2026-08-15T23:42:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 91.591768] postgres[1593]: [1593] ERROR: relation "table_without_models" does not exist1040gitlab # [ 91.592208] postgres[1593]: [1593] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1041gitlab # [ 99.440966] gitlab-workhorse[820]: time="2026-08-15T23:43:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 109.442050] gitlab-workhorse[820]: time="2026-08-15T23:43:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 119.452786] gitlab-workhorse[820]: time="2026-08-15T23:43:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 121.407695] systemd[1]: Finished gitlab-db-config.service.1045gitlab # [ 121.413557] systemd[1]: Started gitlab-sidekiq.service.1046gitlab # [ 121.418952] systemd[1]: Starting gitlab.service...1047gitlab # [ 121.954450] bundle[1959]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1048gitlab # [ 121.957068] bundle[1959]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1049gitlab # [ 121.959378] bundle[1959]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1050gitlab # [ 126.712229] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.570Z","pid":1959,"message":"* Enabling systemd notification integration"}1051gitlab # [ 126.712620] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"Puma starting in cluster mode..."}1052gitlab # [ 126.712733] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1053gitlab # [ 126.712881] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1054gitlab # [ 126.713019] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"* Min threads: 0"}1055gitlab # [ 126.713135] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"* Max threads: 4"}1056gitlab # [ 126.713247] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"* Environment: production"}1057gitlab # [ 126.713367] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"* Master PID: 1959"}1058gitlab # [ 126.713481] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"* Workers: 2"}1059gitlab # [ 126.713593] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1060gitlab # [ 126.713706] bundle[1959]: {"timestamp":"2026-08-15T23:43:33.599Z","pid":1959,"message":"* Preloading application"}1061gitlab # [ 126.841390] sidekiq-cluster[1958]: {"severity":"INFO","time":"2026-08-15T23:43:33.699Z","message":"Starting cluster with 1 processes"}1062gitlab # [ 129.456658] gitlab-workhorse[820]: time="2026-08-15T23:43:36Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 139.459438] gitlab-workhorse[820]: time="2026-08-15T23:43:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 149.461076] gitlab-workhorse[820]: time="2026-08-15T23:43:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 159.470946] gitlab-workhorse[820]: time="2026-08-15T23:44:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 164.466800] bundle[1959]: W, [2026-08-15T23:44:11.353346 #1959] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1067gitlab # [ 169.354271] sidekiq-cluster[2007]: 2026-08-15T23:44:16.240Z pid=2007 tid=wov INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2007, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>423600128}1068gitlab # [ 169.481833] gitlab-workhorse[820]: time="2026-08-15T23:44:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1069gitlab # [ 169.690319] sidekiq-cluster[2007]: W, [2026-08-15T23:44:16.577981 #2007] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1070gitlab # [ 169.837470] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:16.725Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1071gitlab # [ 173.109924] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:19.996Z","message":"GitLab reliable fetch activated!"}1072gitlab # [ 173.110347] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:19.996Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1073gitlab # [ 173.141959] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.029Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1074gitlab # [ 173.148968] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.032Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1075gitlab # [ 173.155997] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.035Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1076gitlab # [ 173.162601] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.038Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1077gitlab # [ 173.170089] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.041Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1078gitlab # [ 173.176721] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.044Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1079gitlab # [ 173.182620] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.046Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1080gitlab # [ 173.188645] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.048Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1081gitlab # [ 173.193410] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.050Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1082gitlab # [ 173.198319] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.052Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1083gitlab # [ 173.203861] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.054Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1084gitlab # [ 173.209239] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.057Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1085gitlab # [ 173.213903] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.059Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1086gitlab # [ 173.218928] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.061Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1087gitlab # [ 173.223794] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.063Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1088gitlab # [ 173.228743] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.065Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1089gitlab # [ 173.233223] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.068Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1090gitlab # [ 173.237386] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.071Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1091gitlab # [ 173.241676] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.075Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1092gitlab # [ 173.245589] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.078Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1093gitlab # [ 173.249727] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.081Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1094gitlab # [ 173.253793] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.084Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1095gitlab # [ 173.257189] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.086Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1096gitlab # [ 173.260526] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.089Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1097gitlab # [ 173.263726] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.091Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1098gitlab # [ 173.266824] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.094Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1099gitlab # [ 173.269718] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.097Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1100gitlab # [ 173.272522] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.100Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1101gitlab # [ 173.275238] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.103Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1102gitlab # [ 173.278320] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.106Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1103gitlab # [ 173.280839] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.108Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1104gitlab # [ 173.283528] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.111Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1105gitlab # [ 173.285973] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.114Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1106gitlab # [ 173.288433] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.117Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1107gitlab # [ 173.290723] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.120Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1108gitlab # [ 173.293052] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.125Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1109gitlab # [ 173.295316] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.130Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1110gitlab # [ 173.297552] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.136Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1111gitlab # [ 173.299825] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.141Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1112gitlab # [ 173.302088] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.145Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1113gitlab # [ 173.304368] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.150Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1114gitlab # [ 173.306475] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.153Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1115gitlab # [ 173.308667] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.157Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1116gitlab # [ 173.310657] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.161Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1117gitlab # [ 173.312843] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.166Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1118gitlab # [ 173.315036] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.170Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1119gitlab # [ 173.317205] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.173Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1120gitlab # [ 173.319272] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.176Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1121gitlab # [ 173.321409] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.180Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1122gitlab # [ 173.323462] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.183Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1123gitlab # [ 173.325603] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.187Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1124gitlab # [ 173.327607] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.192Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1125gitlab # [ 173.329746] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.207Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1126gitlab # [ 173.331967] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.211Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1127gitlab # [ 173.334182] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.215Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1128gitlab # [ 173.336324] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.218Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1129gitlab # [ 173.404176] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.290Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1130gitlab # [ 173.407551] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.295Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1131gitlab # [ 173.410986] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.297Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1132gitlab # [ 173.414427] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.300Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1133gitlab # [ 173.417503] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.303Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1134gitlab # [ 173.420473] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.305Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1135gitlab # [ 173.423626] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.309Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1136gitlab # [ 173.426957] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.313Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1137gitlab # [ 173.430332] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.316Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1138gitlab # [ 173.433588] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.320Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1139gitlab # [ 173.436652] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.323Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1140gitlab # [ 173.439847] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.326Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1141gitlab # [ 173.443455] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.328Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1142gitlab # [ 173.447029] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.331Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1143gitlab # [ 173.450475] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.333Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1144gitlab # [ 173.453717] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.335Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1145gitlab # [ 173.456835] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.337Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1146gitlab # [ 173.460008] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.339Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1147gitlab # [ 173.463016] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.342Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1148gitlab # [ 173.466086] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.344Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1149gitlab # [ 173.468860] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.346Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1150gitlab # [ 173.471811] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.348Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1151gitlab # [ 173.474505] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.351Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1152gitlab # [ 173.476943] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.354Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1153gitlab # [ 173.479485] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.356Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1154gitlab # [ 173.482154] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.358Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1155gitlab # [ 173.484606] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.362Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1156gitlab # [ 173.486953] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.364Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1157gitlab # [ 173.489534] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.366Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1158gitlab # [ 173.491827] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.368Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1159gitlab # [ 173.494367] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.370Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1160gitlab # [ 173.496704] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.373Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1161gitlab # [ 173.498969] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.375Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1162gitlab # [ 173.501312] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.378Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1163gitlab # [ 173.503581] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.380Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1164gitlab # [ 173.505950] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.382Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1165gitlab # [ 173.508214] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.384Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1166gitlab # [ 173.510597] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.386Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1167gitlab # [ 173.512622] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.391Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1168gitlab # [ 173.514916] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.394Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1169gitlab # [ 173.517235] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.396Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1170gitlab # [ 173.519384] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.398Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1171gitlab # [ 173.524661] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.412Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1172gitlab # [ 173.526935] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.414Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1173gitlab # [ 173.530457] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.418Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1174gitlab # [ 173.533758] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.421Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1175gitlab # [ 173.538085] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.425Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1176gitlab # [ 173.540525] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.428Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1177gitlab # [ 173.544087] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.431Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1178gitlab # [ 173.546976] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.433Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1179gitlab # [ 173.549731] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.436Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1180gitlab # [ 173.552606] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.439Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1181gitlab # [ 173.555338] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:44:20.442Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1182gitlab # [ 179.491840] gitlab-workhorse[820]: time="2026-08-15T23:44:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 189.502585] gitlab-workhorse[820]: time="2026-08-15T23:44:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 199.513511] gitlab-workhorse[820]: time="2026-08-15T23:44:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 209.524297] gitlab-workhorse[820]: time="2026-08-15T23:44:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 211.490669] postgres[2718]: [2718] ERROR: relation "table_without_models" does not exist1187gitlab # [ 211.493313] postgres[2718]: [2718] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1188gitlab # [ 214.600309] postgres[2747]: [2747] ERROR: relation "table_without_models" does not exist1189gitlab # [ 214.603778] postgres[2747]: [2747] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1190gitlab # [ 216.858564] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:03.745Z","message":"Booted Rails 7.2.3.1 application in production environment"}1191gitlab # [ 216.864212] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:03.745Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1192gitlab # [ 216.866184] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:03.745Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1193gitlab # [ 216.867936] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:03.745Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1194gitlab # [ 216.870114] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:03.750Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1195gitlab # [ 219.536488] gitlab-workhorse[820]: time="2026-08-15T23:45:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1196gitlab # [ 219.558151] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:06.444Z","message":"Cleaning working queues"}1197gitlab # [ 219.562846] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:06.449Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"848d1ba5761e2eb8cd1e0e0d","created_at":"2026-08-15T23:43:27.721Z","trace_propagation_headers":{"sentry-trace":"f2105186098e48eea19eefa22a6ab810-5bd9c37958754184","baggage":"sentry-trace_id=f2105186098e48eea19eefa22a6ab810,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"bb114c4a0df8268834c9586ac3bf47ac","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:27.733Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-848d1ba5761e2eb8cd1e0e0d: start","job_status":"start","queue_duration_s":98.715868,"scheduling_latency_s":98.715919}1198gitlab # [ 219.913391] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:06.800Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"848d1ba5761e2eb8cd1e0e0d","created_at":"2026-08-15T23:43:27.721Z","trace_propagation_headers":{"sentry-trace":"f2105186098e48eea19eefa22a6ab810-5bd9c37958754184","baggage":"sentry-trace_id=f2105186098e48eea19eefa22a6ab810,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"bb114c4a0df8268834c9586ac3bf47ac","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:43:27.733Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-848d1ba5761e2eb8cd1e0e0d: done: 0.350762 sec","job_status":"done","queue_duration_s":98.715868,"scheduling_latency_s":98.715919,"redis_calls":29,"redis_duration_s":0.011012000000000001,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.006019,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003252,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.191109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20028047999999998,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.350762,"completed_at":"2026-08-15T23:45:06.799Z","load_balancing_strategy":"primary","db_duration_s":0.10216,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1199gitlab # [ 220.308177] bundle[1959]: {"timestamp":"2026-08-15T23:45:07.194Z","pid":1959,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1200gitlab # [ 220.313837] bundle[1959]: {"timestamp":"2026-08-15T23:45:07.195Z","pid":1959,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1201gitlab # [ 220.319185] bundle[1959]: {"timestamp":"2026-08-15T23:45:07.195Z","pid":1959,"message":"! #\u003cThread:0x0000ecebad6c5cb0 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1202gitlab # [ 220.334975] bundle[1959]: {"timestamp":"2026-08-15T23:45:07.195Z","pid":1959,"message":"! #\u003cThread:0x0000ecebad8daed8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1203gitlab # [ 220.350640] bundle[1959]: {"timestamp":"2026-08-15T23:45:07.195Z","pid":1959,"message":"Use Ctrl-C to stop"}1204gitlab # [ 220.354305] bundle[1959]: {"timestamp":"2026-08-15T23:45:07.195Z","pid":1959,"message":"Sending status to systemd every 1.0 sec"}1205gitlab # [ 220.919368] bundle[1959]: {"timestamp":"2026-08-15T23:45:07.806Z","pid":1959,"message":"- Worker 0 (PID: 2856) booted in 0.57s, phase: 0"}1206gitlab # [ 220.924658] bundle[1959]: {"timestamp":"2026-08-15T23:45:07.810Z","pid":1959,"message":"- Worker 1 (PID: 2860) booted in 0.55s, phase: 0"}1207gitlab # [ 220.930388] systemd[1]: Started gitlab.service.1208gitlab # [ 220.932621] systemd[1]: Reached target Common target for all GitLab services..1209gitlab # [ 220.935661] systemd[1]: Starting setup-gitlab.service...1210gitlab # [ 220.958836] setup-gitlab-start[2893]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1211gitlab # [ 224.657058] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:45:11 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 36731212gitlab # [ 224.661063] setup-gitlab-start[2893]: + TOKEN=nixbot-test-token-of-20-chars1213gitlab # [ 224.665974] setup-gitlab-start[2893]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1214gitlab # [ 224.682830] runuser[2915]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1215gitlab # [ 225.239670] setup-gitlab-start[2916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1216gitlab # [ 225.246402] setup-gitlab-start[2916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1217gitlab # [ 225.252739] setup-gitlab-start[2916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1218gitlab # [ 226.055957] setup-gitlab-start[2916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1219gitlab # [ 226.056336] setup-gitlab-start[2916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1220gitlab # [ 226.058559] setup-gitlab-start[2916]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1221gitlab # [ 230.772541] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:17.658Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"db3ec9837ad31ed89ac3c813","created_at":"2026-08-15T23:45:17.546Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36d74d3dbef3912802be11a9329432d4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.655Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-db3ec9837ad31ed89ac3c813: start","job_status":"start","queue_duration_s":0.003032,"scheduling_latency_s":0.003081}1222gitlab # [ 231.024495] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:17.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"db3ec9837ad31ed89ac3c813","created_at":"2026-08-15T23:45:17.546Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36d74d3dbef3912802be11a9329432d4","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.655Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-db3ec9837ad31ed89ac3c813: done: 0.252606 sec","job_status":"done","queue_duration_s":0.003032,"scheduling_latency_s":0.003081,"redis_calls":10,"redis_duration_s":0.016812,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001796,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010106,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0021889,"duration_s":0.252606,"completed_at":"2026-08-15T23:45:17.910Z","load_balancing_strategy":"primary","db_duration_s":0.055176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1223gitlab # [ 231.109961] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:17.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0a5be173dc4376bbfa743cdd","created_at":"2026-08-15T23:45:17.712Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b0c570047b72645869e0c5188f51e08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.738Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0a5be173dc4376bbfa743cdd: start","job_status":"start","queue_duration_s":0.179354,"scheduling_latency_s":0.179403}1224gitlab # [ 231.128062] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:17.948Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1225gitlab # [ 231.131871] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:17.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0a5be173dc4376bbfa743cdd","created_at":"2026-08-15T23:45:17.712Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b0c570047b72645869e0c5188f51e08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.738Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0a5be173dc4376bbfa743cdd: done: 0.048703 sec","job_status":"done","queue_duration_s":0.179354,"scheduling_latency_s":0.179403,"redis_calls":10,"redis_duration_s":0.00435,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000884,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006741,"duration_s":0.048703,"completed_at":"2026-08-15T23:45:17.966Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 231.182386] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:17.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b973947d1c598001984f1bf4","created_at":"2026-08-15T23:45:17.758Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39a46a853f46e1d31b93a7fdf5f3fa48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:45:17.770Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b973947d1c598001984f1bf4: start","job_status":"start","queue_duration_s":0.19883,"scheduling_latency_s":0.198866}1227gitlab # [ 231.211358] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:18.099Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1228gitlab # [ 231.265416] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:18.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b973947d1c598001984f1bf4","created_at":"2026-08-15T23:45:17.758Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39a46a853f46e1d31b93a7fdf5f3fa48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:45:17.770Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b973947d1c598001984f1bf4: done: 0.183012 sec","job_status":"done","queue_duration_s":0.19883,"scheduling_latency_s":0.198866,"redis_calls":10,"redis_duration_s":0.130455,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.033874,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.071502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.025079,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00200374,"duration_s":0.183012,"completed_at":"2026-08-15T23:45:18.151Z","load_balancing_strategy":"primary","db_duration_s":0.005699,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 231.338206] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:18.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"44ed721cbf457a6f1acd4f90","created_at":"2026-08-15T23:45:17.786Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0df68cd97172504c6d4dcbb7024cdbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.801Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-44ed721cbf457a6f1acd4f90: start","job_status":"start","queue_duration_s":0.372004,"scheduling_latency_s":0.37205}1230gitlab # [ 231.421480] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:18.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"44ed721cbf457a6f1acd4f90","created_at":"2026-08-15T23:45:17.786Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0df68cd97172504c6d4dcbb7024cdbfd","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.801Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-44ed721cbf457a6f1acd4f90: done: 0.13507 sec","job_status":"done","queue_duration_s":0.372004,"scheduling_latency_s":0.37205,"redis_calls":11,"redis_duration_s":0.034529000000000004,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.01931,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00291474,"duration_s":0.13507,"completed_at":"2026-08-15T23:45:18.308Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 231.509836] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:18.320Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"0dab9d2118f4905518d9e248","created_at":"2026-08-15T23:45:17.824Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43817e9bab18d3553b7f72cf0a526ac5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.857Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-0dab9d2118f4905518d9e248: start","job_status":"start","queue_duration_s":0.463074,"scheduling_latency_s":0.463123}1232gitlab # [ 231.628072] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:18.514Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"0dab9d2118f4905518d9e248","created_at":"2026-08-15T23:45:17.824Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43817e9bab18d3553b7f72cf0a526ac5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.857Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-0dab9d2118f4905518d9e248: done: 0.19338 sec","job_status":"done","queue_duration_s":0.463074,"scheduling_latency_s":0.463123,"redis_calls":13,"redis_duration_s":0.057438,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.014194,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.022213,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.021031,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0442904,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.19338,"completed_at":"2026-08-15T23:45:18.514Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035254,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1233gitlab # [ 231.714894] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:18.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ad2178503f211efae69796a0","created_at":"2026-08-15T23:45:17.903Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76923b765f80c7d0875163057d9c68b3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.982Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ad2178503f211efae69796a0: start","job_status":"start","queue_duration_s":0.542148,"scheduling_latency_s":0.542202}1234gitlab # [ 232.064732] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:18.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ad2178503f211efae69796a0","created_at":"2026-08-15T23:45:17.903Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76923b765f80c7d0875163057d9c68b3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:17.982Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ad2178503f211efae69796a0: done: 0.425655 sec","job_status":"done","queue_duration_s":0.542148,"scheduling_latency_s":0.542202,"redis_calls":12,"redis_duration_s":0.010998,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003223,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002944,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.073,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.073,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.144611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00397888,"exclusive_lock_hold_duration_s":0.26388572,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.425655,"completed_at":"2026-08-15T23:45:18.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087203,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 232.158592] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:18.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"035b8d7dc1aecc77d5f6af3a","created_at":"2026-08-15T23:45:18.046Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"496e5bd1b9670cfb82ca1e5c7976c829","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.061Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-035b8d7dc1aecc77d5f6af3a: start","job_status":"start","queue_duration_s":0.893567,"scheduling_latency_s":0.893612}1236gitlab # [ 232.175757] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"035b8d7dc1aecc77d5f6af3a","created_at":"2026-08-15T23:45:18.046Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"496e5bd1b9670cfb82ca1e5c7976c829","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.061Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-035b8d7dc1aecc77d5f6af3a: done: 0.046372 sec","job_status":"done","queue_duration_s":0.893567,"scheduling_latency_s":0.893612,"redis_calls":12,"redis_duration_s":0.004123,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001495,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001944,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050634,"duration_s":0.046372,"completed_at":"2026-08-15T23:45:19.001Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 232.223288] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"77918d0e3dbfa7300ee05146","created_at":"2026-08-15T23:45:18.079Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b5d0e0d241c66c8d36d250f5f262b08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.094Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-77918d0e3dbfa7300ee05146: start","job_status":"start","queue_duration_s":0.909185,"scheduling_latency_s":0.909214}1238gitlab # [ 232.239018] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.096Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"77918d0e3dbfa7300ee05146","created_at":"2026-08-15T23:45:18.079Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b5d0e0d241c66c8d36d250f5f262b08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.094Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-77918d0e3dbfa7300ee05146: done: 0.092888 sec","job_status":"done","queue_duration_s":0.909185,"scheduling_latency_s":0.909214,"redis_calls":14,"redis_duration_s":0.005129,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001158,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001733,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008518,"exclusive_lock_hold_duration_s":0.0480766,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.092888,"completed_at":"2026-08-15T23:45:19.096Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 232.285452] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b04fc165479e4d55c38e3c87","created_at":"2026-08-15T23:45:18.131Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28676498056796b5a57ac5d03478a323","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.158Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b04fc165479e4d55c38e3c87: start","job_status":"start","queue_duration_s":0.942401,"scheduling_latency_s":0.942445}1240gitlab # [ 232.299940] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.130Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1241gitlab # [ 232.303279] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.142Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b04fc165479e4d55c38e3c87","created_at":"2026-08-15T23:45:18.131Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28676498056796b5a57ac5d03478a323","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.158Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b04fc165479e4d55c38e3c87: done: 0.042291 sec","job_status":"done","queue_duration_s":0.942401,"scheduling_latency_s":0.942445,"redis_calls":10,"redis_duration_s":0.0027270000000000003,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000547,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006472,"duration_s":0.042291,"completed_at":"2026-08-15T23:45:19.142Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 232.345435] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5e2c3b4d546d0339eb433d9b","created_at":"2026-08-15T23:45:18.164Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.179Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5e2c3b4d546d0339eb433d9b: start","job_status":"start","queue_duration_s":0.964757,"scheduling_latency_s":0.964783}1243gitlab # [ 232.380524] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5e2c3b4d546d0339eb433d9b","created_at":"2026-08-15T23:45:18.164Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.179Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5e2c3b4d546d0339eb433d9b: done: 0.123351 sec","job_status":"done","queue_duration_s":0.964757,"scheduling_latency_s":0.964783,"redis_calls":71,"redis_duration_s":0.013210999999999999,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001679,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001234,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.009642,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000656,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035448,"duration_s":0.123351,"completed_at":"2026-08-15T23:45:19.267Z","load_balancing_strategy":"primary","db_duration_s":0.002062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 232.424099] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"95cf2e7888caca08f0700218","created_at":"2026-08-15T23:45:18.186Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"297f6ed8eb3a5ceeea1810c862dff975","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.198Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-95cf2e7888caca08f0700218: start","job_status":"start","queue_duration_s":1.07112,"scheduling_latency_s":1.071139}1245gitlab # [ 232.714035] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"95cf2e7888caca08f0700218","created_at":"2026-08-15T23:45:18.186Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"297f6ed8eb3a5ceeea1810c862dff975","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.198Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-95cf2e7888caca08f0700218: done: 0.331187 sec","job_status":"done","queue_duration_s":1.07112,"scheduling_latency_s":1.071139,"redis_calls":12,"redis_duration_s":0.0038540000000000002,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000473,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001853,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001528,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.054,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.256813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061316,"exclusive_lock_hold_duration_s":0.30198934,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.331187,"completed_at":"2026-08-15T23:45:19.600Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 232.811317] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:19.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e2600b5bd98ba2bf9e034576","created_at":"2026-08-15T23:45:18.219Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6bf8763a0ff5214e5835c211846b5c37","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.240Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e2600b5bd98ba2bf9e034576: start","job_status":"start","queue_duration_s":1.362917,"scheduling_latency_s":1.362951}1247gitlab # [ 233.206458] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e2600b5bd98ba2bf9e034576","created_at":"2026-08-15T23:45:18.219Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6bf8763a0ff5214e5835c211846b5c37","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.240Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e2600b5bd98ba2bf9e034576: done: 0.488995 sec","job_status":"done","queue_duration_s":1.362917,"scheduling_latency_s":1.362951,"redis_calls":565,"redis_duration_s":0.120911,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000677,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002418,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.117816,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.411455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006628,"duration_s":0.488995,"completed_at":"2026-08-15T23:45:20.092Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000858,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 233.296180] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8ff4ebda01c12cd082f09e52","created_at":"2026-08-15T23:45:18.278Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6f89f5ef782b9ff569dcf50a04e6709","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.302Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8ff4ebda01c12cd082f09e52: start","job_status":"start","queue_duration_s":1.792539,"scheduling_latency_s":1.792573}1249gitlab # [ 233.316343] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"8ff4ebda01c12cd082f09e52","created_at":"2026-08-15T23:45:18.278Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6f89f5ef782b9ff569dcf50a04e6709","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.302Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-8ff4ebda01c12cd082f09e52: done: 0.078521 sec","job_status":"done","queue_duration_s":1.792539,"scheduling_latency_s":1.792573,"redis_calls":10,"redis_duration_s":0.004276,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000692,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00101276,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.078521,"completed_at":"2026-08-15T23:45:20.173Z","load_balancing_strategy":"primary","db_duration_s":0.030094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 233.366592] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"764aac153923d9d9705b56da","created_at":"2026-08-15T23:45:18.319Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2045044a6d4324ac3c3b6e10cb39f6b3","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.336Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-764aac153923d9d9705b56da: start","job_status":"start","queue_duration_s":1.840826,"scheduling_latency_s":1.840864}1251gitlab # [ 233.380147] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"764aac153923d9d9705b56da","created_at":"2026-08-15T23:45:18.319Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2045044a6d4324ac3c3b6e10cb39f6b3","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.336Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-764aac153923d9d9705b56da: done: 0.072292 sec","job_status":"done","queue_duration_s":1.840826,"scheduling_latency_s":1.840864,"redis_calls":10,"redis_duration_s":0.0028539999999999998,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000658,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043136,"duration_s":0.072292,"completed_at":"2026-08-15T23:45:20.249Z","load_balancing_strategy":"primary","db_duration_s":0.016381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 233.421156] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f94589d020a4ab3a7b9b6f73","created_at":"2026-08-15T23:45:18.373Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92cca4a8f7e9a32e136de6a215b4be52","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:45:18.395Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f94589d020a4ab3a7b9b6f73: start","job_status":"start","queue_duration_s":1.856682,"scheduling_latency_s":1.856711}1253gitlab # [ 233.434618] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.270Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1254gitlab # [ 233.439332] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f94589d020a4ab3a7b9b6f73","created_at":"2026-08-15T23:45:18.373Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92cca4a8f7e9a32e136de6a215b4be52","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:45:18.395Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f94589d020a4ab3a7b9b6f73: done: 0.028563 sec","job_status":"done","queue_duration_s":1.856682,"scheduling_latency_s":1.856711,"redis_calls":10,"redis_duration_s":0.001921,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000392,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032996,"duration_s":0.028563,"completed_at":"2026-08-15T23:45:20.281Z","load_balancing_strategy":"primary","db_duration_s":0.000816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 233.480453] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.282Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"693f30d27c0175e217e9e5f8","created_at":"2026-08-15T23:45:18.403Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347ae3a60aab5788679bd926fc2638b3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.433Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-693f30d27c0175e217e9e5f8: start","job_status":"start","queue_duration_s":1.849351,"scheduling_latency_s":1.849375}1256gitlab # [ 233.493572] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.319Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"693f30d27c0175e217e9e5f8","created_at":"2026-08-15T23:45:18.403Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347ae3a60aab5788679bd926fc2638b3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.433Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-693f30d27c0175e217e9e5f8: done: 0.03677 sec","job_status":"done","queue_duration_s":1.849351,"scheduling_latency_s":1.849375,"redis_calls":11,"redis_duration_s":0.002017,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000607,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033882,"duration_s":0.03677,"completed_at":"2026-08-15T23:45:20.319Z","load_balancing_strategy":"primary","db_duration_s":0.005966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 233.534039] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"074d3ca98422662428fbd65b","created_at":"2026-08-15T23:45:18.445Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ff556077c656d62627008ea9496f573","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.465Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-074d3ca98422662428fbd65b: start","job_status":"start","queue_duration_s":1.855735,"scheduling_latency_s":1.855758}1258gitlab # [ 233.548447] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.335Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1259gitlab # [ 233.551830] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.344Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"074d3ca98422662428fbd65b","created_at":"2026-08-15T23:45:18.445Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ff556077c656d62627008ea9496f573","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.465Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-074d3ca98422662428fbd65b: done: 0.023734 sec","job_status":"done","queue_duration_s":1.855735,"scheduling_latency_s":1.855758,"redis_calls":10,"redis_duration_s":0.001608,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000344,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002656,"duration_s":0.023734,"completed_at":"2026-08-15T23:45:20.344Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 233.593736] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"1499e5f23b64f893f70606ce","created_at":"2026-08-15T23:45:18.472Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57a08fe4d3f1f7f7cc87a533d07bb192","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.507Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-1499e5f23b64f893f70606ce: start","job_status":"start","queue_duration_s":1.838937,"scheduling_latency_s":1.838959}1261gitlab # [ 233.607543] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"1499e5f23b64f893f70606ce","created_at":"2026-08-15T23:45:18.472Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57a08fe4d3f1f7f7cc87a533d07bb192","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.507Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-1499e5f23b64f893f70606ce: done: 0.029121 sec","job_status":"done","queue_duration_s":1.838937,"scheduling_latency_s":1.838959,"redis_calls":10,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000338,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026472,"duration_s":0.029121,"completed_at":"2026-08-15T23:45:20.375Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 233.650179] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.376Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3dd26af06a00dce206110740","created_at":"2026-08-15T23:45:18.540Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3cf72d92b18310fa434ae3630495386","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.587Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3dd26af06a00dce206110740: start","job_status":"start","queue_duration_s":1.789848,"scheduling_latency_s":1.789868}1263gitlab # [ 233.664278] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.521Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3dd26af06a00dce206110740","created_at":"2026-08-15T23:45:18.540Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3cf72d92b18310fa434ae3630495386","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.587Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3dd26af06a00dce206110740: done: 0.144575 sec","job_status":"done","queue_duration_s":1.789848,"scheduling_latency_s":1.789868,"redis_calls":16,"redis_duration_s":0.002331,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001182,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024348,"duration_s":0.144575,"completed_at":"2026-08-15T23:45:20.521Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008404,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 233.705628] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"cdadc83945077254b9acf070","created_at":"2026-08-15T23:45:18.613Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.632Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-cdadc83945077254b9acf070: start","job_status":"start","queue_duration_s":1.890123,"scheduling_latency_s":1.890141}1265gitlab # [ 233.718991] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.558Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"cdadc83945077254b9acf070","created_at":"2026-08-15T23:45:18.613Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.632Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-cdadc83945077254b9acf070: done: 0.03634 sec","job_status":"done","queue_duration_s":1.890123,"scheduling_latency_s":1.890141,"redis_calls":19,"redis_duration_s":0.002531,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000587,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000229,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00129,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023398,"duration_s":0.03634,"completed_at":"2026-08-15T23:45:20.558Z","load_balancing_strategy":"primary","db_duration_s":0.003357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 233.761073] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"062ec58e62fad897b7823006","created_at":"2026-08-15T23:45:18.655Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc90f527929058c25ec0de01c79a6bc0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.718Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-062ec58e62fad897b7823006: start","job_status":"start","queue_duration_s":1.84226,"scheduling_latency_s":1.842279}1267gitlab # [ 233.774745] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"062ec58e62fad897b7823006","created_at":"2026-08-15T23:45:18.655Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc90f527929058c25ec0de01c79a6bc0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.718Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-062ec58e62fad897b7823006: done: 0.020769 sec","job_status":"done","queue_duration_s":1.84226,"scheduling_latency_s":1.842279,"redis_calls":11,"redis_duration_s":0.001508,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000232,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022496,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.020769,"completed_at":"2026-08-15T23:45:20.580Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 233.818163] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"13c0c9624035f632980ea3c6","created_at":"2026-08-15T23:45:18.756Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4fa5c0e3aed9a780f9f629ad4a17cc9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.771Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-13c0c9624035f632980ea3c6: start","job_status":"start","queue_duration_s":1.810808,"scheduling_latency_s":1.810826}1269gitlab # [ 233.832719] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.592Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1270gitlab # [ 233.836399] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"13c0c9624035f632980ea3c6","created_at":"2026-08-15T23:45:18.756Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4fa5c0e3aed9a780f9f629ad4a17cc9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.771Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-13c0c9624035f632980ea3c6: done: 0.017586 sec","job_status":"done","queue_duration_s":1.810808,"scheduling_latency_s":1.810826,"redis_calls":10,"redis_duration_s":0.001316,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002358,"duration_s":0.017586,"completed_at":"2026-08-15T23:45:20.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00055,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 233.879754] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ce31cc54d07025c11dfb260a","created_at":"2026-08-15T23:45:18.805Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e50a942878f0613499c510686a817533","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.814Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ce31cc54d07025c11dfb260a: start","job_status":"start","queue_duration_s":1.786272,"scheduling_latency_s":1.786289}1272gitlab # [ 233.893252] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"ce31cc54d07025c11dfb260a","created_at":"2026-08-15T23:45:18.805Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e50a942878f0613499c510686a817533","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.814Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-ce31cc54d07025c11dfb260a: done: 0.02701 sec","job_status":"done","queue_duration_s":1.786272,"scheduling_latency_s":1.786289,"redis_calls":12,"redis_duration_s":0.001779,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000728,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00046648,"exclusive_lock_hold_duration_s":0.00937518,"duration_s":0.02701,"completed_at":"2026-08-15T23:45:20.627Z","load_balancing_strategy":"primary","db_duration_s":0.004781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 233.935492] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.629Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5162bf688f3e7490d35de8d2","created_at":"2026-08-15T23:45:18.843Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba79db21f498ad9272719465744a31af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:45:18.851Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5162bf688f3e7490d35de8d2: start","job_status":"start","queue_duration_s":1.77731,"scheduling_latency_s":1.777327}1274gitlab # [ 233.949082] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5162bf688f3e7490d35de8d2","created_at":"2026-08-15T23:45:18.843Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba79db21f498ad9272719465744a31af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:45:18.851Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5162bf688f3e7490d35de8d2: done: 0.03359 sec","job_status":"done","queue_duration_s":1.77731,"scheduling_latency_s":1.777327,"redis_calls":10,"redis_duration_s":0.001364,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002238,"duration_s":0.03359,"completed_at":"2026-08-15T23:45:20.662Z","load_balancing_strategy":"primary","db_duration_s":0.005783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 233.990764] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"5f854e0159af709fdad4303c","created_at":"2026-08-15T23:45:18.860Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7130966f2961c59edb92bc1ae461fdaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.867Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-5f854e0159af709fdad4303c: start","job_status":"start","queue_duration_s":1.796011,"scheduling_latency_s":1.796028}1276gitlab # [ 234.005715] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"5f854e0159af709fdad4303c","created_at":"2026-08-15T23:45:18.860Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7130966f2961c59edb92bc1ae461fdaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.867Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-5f854e0159af709fdad4303c: done: 0.018075 sec","job_status":"done","queue_duration_s":1.796011,"scheduling_latency_s":1.796028,"redis_calls":10,"redis_duration_s":0.001284,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002266,"duration_s":0.018075,"completed_at":"2026-08-15T23:45:20.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 234.048216] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.683Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"46354a1f9f92b48687ae3f47","created_at":"2026-08-15T23:45:18.873Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f467ee2dcb9016366299db8da7120dcd","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.887Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-46354a1f9f92b48687ae3f47: start","job_status":"start","queue_duration_s":1.795736,"scheduling_latency_s":1.795753}1278gitlab # [ 234.063735] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"46354a1f9f92b48687ae3f47","created_at":"2026-08-15T23:45:18.873Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f467ee2dcb9016366299db8da7120dcd","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:45:18.887Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-46354a1f9f92b48687ae3f47: done: 0.021508 sec","job_status":"done","queue_duration_s":1.795736,"scheduling_latency_s":1.795753,"redis_calls":12,"redis_duration_s":0.001631,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045534,"exclusive_lock_hold_duration_s":0.00376086,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.021508,"completed_at":"2026-08-15T23:45:20.704Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 234.107322] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aedbdd0739a16a9950c6702","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aedbdd0739a16a9950c6702: start","job_status":"start","queue_duration_s":1.447882,"scheduling_latency_s":1.447899}1280gitlab # [ 234.119766] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aedbdd0739a16a9950c6702","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aedbdd0739a16a9950c6702: done: 0.022702 sec","job_status":"done","queue_duration_s":1.447882,"scheduling_latency_s":1.447899,"redis_calls":16,"redis_duration_s":0.002084,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001245,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002555,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022702,"completed_at":"2026-08-15T23:45:20.728Z","load_balancing_strategy":"primary","db_duration_s":0.000581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 234.161135] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98468d9add26dac1471b0f80","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98468d9add26dac1471b0f80: start","job_status":"start","queue_duration_s":1.471643,"scheduling_latency_s":1.47166}1282gitlab # [ 234.173785] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98468d9add26dac1471b0f80","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98468d9add26dac1471b0f80: done: 0.014429 sec","job_status":"done","queue_duration_s":1.471643,"scheduling_latency_s":1.47166,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014429,"completed_at":"2026-08-15T23:45:20.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 234.213298] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c780662f05a813b1ae758d2","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c780662f05a813b1ae758d2: start","job_status":"start","queue_duration_s":1.48807,"scheduling_latency_s":1.488089}1284gitlab # [ 234.225830] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c780662f05a813b1ae758d2","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c780662f05a813b1ae758d2: done: 0.01464 sec","job_status":"done","queue_duration_s":1.48807,"scheduling_latency_s":1.488089,"redis_calls":13,"redis_duration_s":0.002085,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01464,"completed_at":"2026-08-15T23:45:20.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 234.266066] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28db8c15b7cf2222202e6f7d","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28db8c15b7cf2222202e6f7d: start","job_status":"start","queue_duration_s":1.503775,"scheduling_latency_s":1.503791}1286gitlab # [ 234.278384] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28db8c15b7cf2222202e6f7d","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28db8c15b7cf2222202e6f7d: done: 0.014941 sec","job_status":"done","queue_duration_s":1.503775,"scheduling_latency_s":1.503791,"redis_calls":13,"redis_duration_s":0.002074,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001573,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-08-15T23:45:20.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 234.318037] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75dfc65fa06f597d2718957d","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75dfc65fa06f597d2718957d: start","job_status":"start","queue_duration_s":1.519732,"scheduling_latency_s":1.519749}1288gitlab # [ 234.330675] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75dfc65fa06f597d2718957d","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75dfc65fa06f597d2718957d: done: 0.014685 sec","job_status":"done","queue_duration_s":1.519732,"scheduling_latency_s":1.519749,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014685,"completed_at":"2026-08-15T23:45:20.792Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 234.370732] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"104fc1e94792e5fe9f0ac1c8","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-104fc1e94792e5fe9f0ac1c8: start","job_status":"start","queue_duration_s":1.53544,"scheduling_latency_s":1.535456}1290gitlab # [ 234.383422] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"104fc1e94792e5fe9f0ac1c8","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-104fc1e94792e5fe9f0ac1c8: done: 0.01428 sec","job_status":"done","queue_duration_s":1.53544,"scheduling_latency_s":1.535456,"redis_calls":13,"redis_duration_s":0.0014160000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01428,"completed_at":"2026-08-15T23:45:20.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 234.423389] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57be3047a4bd9d795dfb0781","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57be3047a4bd9d795dfb0781: start","job_status":"start","queue_duration_s":1.551463,"scheduling_latency_s":1.55148}1292gitlab # [ 234.436257] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57be3047a4bd9d795dfb0781","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57be3047a4bd9d795dfb0781: done: 0.014181 sec","job_status":"done","queue_duration_s":1.551463,"scheduling_latency_s":1.55148,"redis_calls":13,"redis_duration_s":0.001466,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014181,"completed_at":"2026-08-15T23:45:20.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 234.477307] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b5ee05d28593a9ed511488","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b5ee05d28593a9ed511488: start","job_status":"start","queue_duration_s":1.566721,"scheduling_latency_s":1.566737}1294gitlab # [ 234.489843] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b5ee05d28593a9ed511488","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b5ee05d28593a9ed511488: done: 0.014673 sec","job_status":"done","queue_duration_s":1.566721,"scheduling_latency_s":1.566737,"redis_calls":13,"redis_duration_s":0.001484,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014673,"completed_at":"2026-08-15T23:45:20.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 234.528990] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0968a7125699d90526abde8","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0968a7125699d90526abde8: start","job_status":"start","queue_duration_s":1.582519,"scheduling_latency_s":1.582536}1296gitlab # [ 234.541184] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0968a7125699d90526abde8","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0968a7125699d90526abde8: done: 0.014724 sec","job_status":"done","queue_duration_s":1.582519,"scheduling_latency_s":1.582536,"redis_calls":13,"redis_duration_s":0.001585,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014724,"completed_at":"2026-08-15T23:45:20.855Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 234.580150] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17e6eef45558c95aeb8d0e8f","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17e6eef45558c95aeb8d0e8f: start","job_status":"start","queue_duration_s":1.598303,"scheduling_latency_s":1.598319}1298gitlab # [ 234.592592] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17e6eef45558c95aeb8d0e8f","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17e6eef45558c95aeb8d0e8f: done: 0.015287 sec","job_status":"done","queue_duration_s":1.598303,"scheduling_latency_s":1.598319,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015287,"completed_at":"2026-08-15T23:45:20.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 234.631792] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4403793e8f6cf3a05e5583d1","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4403793e8f6cf3a05e5583d1: start","job_status":"start","queue_duration_s":1.614678,"scheduling_latency_s":1.614695}1300gitlab # [ 234.644672] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4403793e8f6cf3a05e5583d1","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4403793e8f6cf3a05e5583d1: done: 0.014646 sec","job_status":"done","queue_duration_s":1.614678,"scheduling_latency_s":1.614695,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014646,"completed_at":"2026-08-15T23:45:20.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 234.684597] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cec3399d9cf9d8e02fb2573","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cec3399d9cf9d8e02fb2573: start","job_status":"start","queue_duration_s":1.630417,"scheduling_latency_s":1.630435}1302gitlab # [ 234.697869] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cec3399d9cf9d8e02fb2573","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cec3399d9cf9d8e02fb2573: done: 0.014428 sec","job_status":"done","queue_duration_s":1.630417,"scheduling_latency_s":1.630435,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014428,"completed_at":"2026-08-15T23:45:20.902Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 234.738079] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bd873423b0fd471a5209e2b","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bd873423b0fd471a5209e2b: start","job_status":"start","queue_duration_s":1.645884,"scheduling_latency_s":1.645901}1304gitlab # [ 234.750945] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bd873423b0fd471a5209e2b","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bd873423b0fd471a5209e2b: done: 0.01442 sec","job_status":"done","queue_duration_s":1.645884,"scheduling_latency_s":1.645901,"redis_calls":13,"redis_duration_s":0.0014390000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01442,"completed_at":"2026-08-15T23:45:20.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 234.790843] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7f37555628a0504ec02ee9f","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7f37555628a0504ec02ee9f: start","job_status":"start","queue_duration_s":1.662533,"scheduling_latency_s":1.662551}1306gitlab # [ 234.803745] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7f37555628a0504ec02ee9f","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7f37555628a0504ec02ee9f: done: 0.015252 sec","job_status":"done","queue_duration_s":1.662533,"scheduling_latency_s":1.662551,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015252,"completed_at":"2026-08-15T23:45:20.935Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 234.843985] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"859918c5f07f55264ff8cae4","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-859918c5f07f55264ff8cae4: start","job_status":"start","queue_duration_s":1.678852,"scheduling_latency_s":1.67887}1308gitlab # [ 234.856341] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"859918c5f07f55264ff8cae4","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-859918c5f07f55264ff8cae4: done: 0.015552 sec","job_status":"done","queue_duration_s":1.678852,"scheduling_latency_s":1.67887,"redis_calls":13,"redis_duration_s":0.001455,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015552,"completed_at":"2026-08-15T23:45:20.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 234.897263] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b95f2302f6fced6015f3698e","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b95f2302f6fced6015f3698e: start","job_status":"start","queue_duration_s":1.695421,"scheduling_latency_s":1.695437}1310gitlab # [ 234.909584] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b95f2302f6fced6015f3698e","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b95f2302f6fced6015f3698e: done: 0.014923 sec","job_status":"done","queue_duration_s":1.695421,"scheduling_latency_s":1.695437,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014923,"completed_at":"2026-08-15T23:45:20.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 234.948989] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b6c7d77ce9a0cd11b34f56e","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b6c7d77ce9a0cd11b34f56e: start","job_status":"start","queue_duration_s":1.711427,"scheduling_latency_s":1.711444}1312gitlab # [ 234.961322] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b6c7d77ce9a0cd11b34f56e","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b6c7d77ce9a0cd11b34f56e: done: 0.015076 sec","job_status":"done","queue_duration_s":1.711427,"scheduling_latency_s":1.711444,"redis_calls":13,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015076,"completed_at":"2026-08-15T23:45:20.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 235.000611] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"577f8841f54149d73a6a26ac","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-577f8841f54149d73a6a26ac: start","job_status":"start","queue_duration_s":1.727603,"scheduling_latency_s":1.727619}1314gitlab # [ 235.013031] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:20.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"577f8841f54149d73a6a26ac","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-577f8841f54149d73a6a26ac: done: 0.014274 sec","job_status":"done","queue_duration_s":1.727603,"scheduling_latency_s":1.727619,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014274,"completed_at":"2026-08-15T23:45:20.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 235.052270] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cad0c9610323002e61deeb73","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cad0c9610323002e61deeb73: start","job_status":"start","queue_duration_s":1.742942,"scheduling_latency_s":1.742959}1316gitlab # [ 235.064266] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cad0c9610323002e61deeb73","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cad0c9610323002e61deeb73: done: 0.014369 sec","job_status":"done","queue_duration_s":1.742942,"scheduling_latency_s":1.742959,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014369,"completed_at":"2026-08-15T23:45:21.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 235.104769] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7b96157339110fd1a824770","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7b96157339110fd1a824770: start","job_status":"start","queue_duration_s":1.758387,"scheduling_latency_s":1.758404}1318gitlab # [ 235.117167] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7b96157339110fd1a824770","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7b96157339110fd1a824770: done: 0.014179 sec","job_status":"done","queue_duration_s":1.758387,"scheduling_latency_s":1.758404,"redis_calls":13,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014179,"completed_at":"2026-08-15T23:45:21.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 235.156740] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c406bdf2e419e92332ac036f","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c406bdf2e419e92332ac036f: start","job_status":"start","queue_duration_s":1.773621,"scheduling_latency_s":1.773638}1320gitlab # [ 235.169258] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c406bdf2e419e92332ac036f","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c406bdf2e419e92332ac036f: done: 0.014011 sec","job_status":"done","queue_duration_s":1.773621,"scheduling_latency_s":1.773638,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014011,"completed_at":"2026-08-15T23:45:21.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 235.209006] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aedc7ae49d0787971ad6b52c","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aedc7ae49d0787971ad6b52c: start","job_status":"start","queue_duration_s":1.788923,"scheduling_latency_s":1.788941}1322gitlab # [ 235.221660] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aedc7ae49d0787971ad6b52c","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aedc7ae49d0787971ad6b52c: done: 0.014215 sec","job_status":"done","queue_duration_s":1.788923,"scheduling_latency_s":1.788941,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014215,"completed_at":"2026-08-15T23:45:21.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 235.261313] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9171d6ecb8a0ac6e6bba3c7","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9171d6ecb8a0ac6e6bba3c7: start","job_status":"start","queue_duration_s":1.804375,"scheduling_latency_s":1.804393}1324gitlab # [ 235.274951] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9171d6ecb8a0ac6e6bba3c7","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9171d6ecb8a0ac6e6bba3c7: done: 0.014053 sec","job_status":"done","queue_duration_s":1.804375,"scheduling_latency_s":1.804393,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014053,"completed_at":"2026-08-15T23:45:21.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 235.313826] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d53ae5589ea47113af78e3f8","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d53ae5589ea47113af78e3f8: start","job_status":"start","queue_duration_s":1.819528,"scheduling_latency_s":1.819545}1326gitlab # [ 235.325921] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d53ae5589ea47113af78e3f8","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d53ae5589ea47113af78e3f8: done: 0.014295 sec","job_status":"done","queue_duration_s":1.819528,"scheduling_latency_s":1.819545,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014295,"completed_at":"2026-08-15T23:45:21.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 235.365662] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16dd6271c193aa92dcc049cc","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16dd6271c193aa92dcc049cc: start","job_status":"start","queue_duration_s":1.834935,"scheduling_latency_s":1.834952}1328gitlab # [ 235.378871] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16dd6271c193aa92dcc049cc","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16dd6271c193aa92dcc049cc: done: 0.013848 sec","job_status":"done","queue_duration_s":1.834935,"scheduling_latency_s":1.834952,"redis_calls":13,"redis_duration_s":0.001404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013848,"completed_at":"2026-08-15T23:45:21.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 235.418524] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1db93469abf144349b67c49a","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1db93469abf144349b67c49a: start","job_status":"start","queue_duration_s":1.849899,"scheduling_latency_s":1.849915}1330gitlab # [ 235.430957] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1db93469abf144349b67c49a","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1db93469abf144349b67c49a: done: 0.014385 sec","job_status":"done","queue_duration_s":1.849899,"scheduling_latency_s":1.849915,"redis_calls":13,"redis_duration_s":0.001385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014385,"completed_at":"2026-08-15T23:45:21.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 235.470922] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88f927ae928d38b57dbb9953","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88f927ae928d38b57dbb9953: start","job_status":"start","queue_duration_s":1.86586,"scheduling_latency_s":1.865877}1332gitlab # [ 235.484516] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88f927ae928d38b57dbb9953","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88f927ae928d38b57dbb9953: done: 0.014788 sec","job_status":"done","queue_duration_s":1.86586,"scheduling_latency_s":1.865877,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014788,"completed_at":"2026-08-15T23:45:21.138Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 235.523224] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9ef54200bdbff6f6b8399d7","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9ef54200bdbff6f6b8399d7: start","job_status":"start","queue_duration_s":1.881724,"scheduling_latency_s":1.88174}1334gitlab # [ 235.536329] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9ef54200bdbff6f6b8399d7","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9ef54200bdbff6f6b8399d7: done: 0.014938 sec","job_status":"done","queue_duration_s":1.881724,"scheduling_latency_s":1.88174,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014938,"completed_at":"2026-08-15T23:45:21.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 235.576085] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"290c1f570131b1a2156ee4cf","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-290c1f570131b1a2156ee4cf: start","job_status":"start","queue_duration_s":1.897726,"scheduling_latency_s":1.897742}1336gitlab # [ 235.588301] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"290c1f570131b1a2156ee4cf","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-290c1f570131b1a2156ee4cf: done: 0.014986 sec","job_status":"done","queue_duration_s":1.897726,"scheduling_latency_s":1.897742,"redis_calls":13,"redis_duration_s":0.0015279999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014986,"completed_at":"2026-08-15T23:45:21.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 235.627094] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"986ebf261573ea014cc72936","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-986ebf261573ea014cc72936: start","job_status":"start","queue_duration_s":1.913838,"scheduling_latency_s":1.913855}1338gitlab # [ 235.639648] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"986ebf261573ea014cc72936","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-986ebf261573ea014cc72936: done: 0.015036 sec","job_status":"done","queue_duration_s":1.913838,"scheduling_latency_s":1.913855,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015036,"completed_at":"2026-08-15T23:45:21.186Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 235.678655] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e6cf0e8fb4d519cde7c6a09","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e6cf0e8fb4d519cde7c6a09: start","job_status":"start","queue_duration_s":1.93031,"scheduling_latency_s":1.930327}1340gitlab # [ 235.691772] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e6cf0e8fb4d519cde7c6a09","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e6cf0e8fb4d519cde7c6a09: done: 0.014294 sec","job_status":"done","queue_duration_s":1.93031,"scheduling_latency_s":1.930327,"redis_calls":13,"redis_duration_s":0.0014260000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014294,"completed_at":"2026-08-15T23:45:21.202Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 235.731004] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b13d6238f8fafdf3529ec0c4","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b13d6238f8fafdf3529ec0c4: start","job_status":"start","queue_duration_s":1.945713,"scheduling_latency_s":1.945731}1342gitlab # [ 235.743334] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b13d6238f8fafdf3529ec0c4","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b13d6238f8fafdf3529ec0c4: done: 0.014368 sec","job_status":"done","queue_duration_s":1.945713,"scheduling_latency_s":1.945731,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014368,"completed_at":"2026-08-15T23:45:21.217Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 235.781898] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d9da73486892a77f1905c39","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d9da73486892a77f1905c39: start","job_status":"start","queue_duration_s":1.961211,"scheduling_latency_s":1.961229}1344gitlab # [ 235.794262] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d9da73486892a77f1905c39","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d9da73486892a77f1905c39: done: 0.015089 sec","job_status":"done","queue_duration_s":1.961211,"scheduling_latency_s":1.961229,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015089,"completed_at":"2026-08-15T23:45:21.234Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 235.833823] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3e1f88d3b45c4f1c7068300","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3e1f88d3b45c4f1c7068300: start","job_status":"start","queue_duration_s":1.977588,"scheduling_latency_s":1.977605}1346gitlab # [ 235.871477] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3e1f88d3b45c4f1c7068300","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3e1f88d3b45c4f1c7068300: done: 0.014366 sec","job_status":"done","queue_duration_s":1.977588,"scheduling_latency_s":1.977605,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014366,"completed_at":"2026-08-15T23:45:21.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 235.946797] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bfe40f07c46ac8c753a30c1","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bfe40f07c46ac8c753a30c1: start","job_status":"start","queue_duration_s":1.993332,"scheduling_latency_s":1.993349}1348gitlab # [ 235.965707] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bfe40f07c46ac8c753a30c1","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bfe40f07c46ac8c753a30c1: done: 0.014792 sec","job_status":"done","queue_duration_s":1.993332,"scheduling_latency_s":1.993349,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014792,"completed_at":"2026-08-15T23:45:21.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 236.011227] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21842b1360f20d58583aaa5c","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21842b1360f20d58583aaa5c: start","job_status":"start","queue_duration_s":2.009317,"scheduling_latency_s":2.009335}1350gitlab # [ 236.023539] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21842b1360f20d58583aaa5c","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21842b1360f20d58583aaa5c: done: 0.015364 sec","job_status":"done","queue_duration_s":2.009317,"scheduling_latency_s":2.009335,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015364,"completed_at":"2026-08-15T23:45:21.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 236.062093] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b828db075a2bae9ddfe6fb7","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b828db075a2bae9ddfe6fb7: start","job_status":"start","queue_duration_s":2.025786,"scheduling_latency_s":2.025802}1352gitlab # [ 236.074447] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b828db075a2bae9ddfe6fb7","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b828db075a2bae9ddfe6fb7: done: 0.015011 sec","job_status":"done","queue_duration_s":2.025786,"scheduling_latency_s":2.025802,"redis_calls":13,"redis_duration_s":0.0014429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015011,"completed_at":"2026-08-15T23:45:21.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 236.112964] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb361ac50cc7b91c427e231e","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb361ac50cc7b91c427e231e: start","job_status":"start","queue_duration_s":2.042629,"scheduling_latency_s":2.042648}1354gitlab # [ 236.126076] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb361ac50cc7b91c427e231e","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb361ac50cc7b91c427e231e: done: 0.016028 sec","job_status":"done","queue_duration_s":2.042629,"scheduling_latency_s":2.042648,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016028,"completed_at":"2026-08-15T23:45:21.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 236.165048] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79c4cd86d42a1de216af5cbf","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79c4cd86d42a1de216af5cbf: start","job_status":"start","queue_duration_s":2.060109,"scheduling_latency_s":2.060126}1356gitlab # [ 236.177379] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79c4cd86d42a1de216af5cbf","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79c4cd86d42a1de216af5cbf: done: 0.015545 sec","job_status":"done","queue_duration_s":2.060109,"scheduling_latency_s":2.060126,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015545,"completed_at":"2026-08-15T23:45:21.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 236.216070] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e43b5115bffabb083ff2d013","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e43b5115bffabb083ff2d013: start","job_status":"start","queue_duration_s":2.076767,"scheduling_latency_s":2.076783}1358gitlab # [ 236.228745] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e43b5115bffabb083ff2d013","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e43b5115bffabb083ff2d013: done: 0.016195 sec","job_status":"done","queue_duration_s":2.076767,"scheduling_latency_s":2.076783,"redis_calls":13,"redis_duration_s":0.001903,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001357,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016195,"completed_at":"2026-08-15T23:45:21.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 236.267742] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"739365a1a9047e084c2d9d93","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-739365a1a9047e084c2d9d93: start","job_status":"start","queue_duration_s":2.094052,"scheduling_latency_s":2.094069}1360gitlab # [ 236.280225] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"739365a1a9047e084c2d9d93","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-739365a1a9047e084c2d9d93: done: 0.015909 sec","job_status":"done","queue_duration_s":2.094052,"scheduling_latency_s":2.094069,"redis_calls":13,"redis_duration_s":0.001861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001322,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015909,"completed_at":"2026-08-15T23:45:21.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 236.319295] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88bedce12855c0330d249c41","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88bedce12855c0330d249c41: start","job_status":"start","queue_duration_s":2.111069,"scheduling_latency_s":2.111085}1362gitlab # [ 236.332566] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88bedce12855c0330d249c41","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88bedce12855c0330d249c41: done: 0.015851 sec","job_status":"done","queue_duration_s":2.111069,"scheduling_latency_s":2.111085,"redis_calls":13,"redis_duration_s":0.001895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001371,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015851,"completed_at":"2026-08-15T23:45:21.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 236.371403] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f7777e45e4356a7b0df1acd","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f7777e45e4356a7b0df1acd: start","job_status":"start","queue_duration_s":2.127965,"scheduling_latency_s":2.127982}1364gitlab # [ 236.383622] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f7777e45e4356a7b0df1acd","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f7777e45e4356a7b0df1acd: done: 0.015897 sec","job_status":"done","queue_duration_s":2.127965,"scheduling_latency_s":2.127982,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015897,"completed_at":"2026-08-15T23:45:21.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 236.422744] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ee31f463e7e90b6794ef32","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ee31f463e7e90b6794ef32: start","job_status":"start","queue_duration_s":2.144947,"scheduling_latency_s":2.144964}1366gitlab # [ 236.435203] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7ee31f463e7e90b6794ef32","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7ee31f463e7e90b6794ef32: done: 0.015356 sec","job_status":"done","queue_duration_s":2.144947,"scheduling_latency_s":2.144964,"redis_calls":13,"redis_duration_s":0.001912,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015356,"completed_at":"2026-08-15T23:45:21.418Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 236.474011] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"452229bcfa0488d7c00e14eb","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-452229bcfa0488d7c00e14eb: start","job_status":"start","queue_duration_s":2.161677,"scheduling_latency_s":2.161695}1368gitlab # [ 236.486409] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"452229bcfa0488d7c00e14eb","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-452229bcfa0488d7c00e14eb: done: 0.015744 sec","job_status":"done","queue_duration_s":2.161677,"scheduling_latency_s":2.161695,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015744,"completed_at":"2026-08-15T23:45:21.435Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 236.525349] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e4ed619c4ade7fa1e72084d","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e4ed619c4ade7fa1e72084d: start","job_status":"start","queue_duration_s":2.178995,"scheduling_latency_s":2.179013}1370gitlab # [ 236.538824] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e4ed619c4ade7fa1e72084d","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e4ed619c4ade7fa1e72084d: done: 0.015491 sec","job_status":"done","queue_duration_s":2.178995,"scheduling_latency_s":2.179013,"redis_calls":13,"redis_duration_s":0.001613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015491,"completed_at":"2026-08-15T23:45:21.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 236.577874] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"757ff6b5ee9788ab5947f42e","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-757ff6b5ee9788ab5947f42e: start","job_status":"start","queue_duration_s":2.195884,"scheduling_latency_s":2.195901}1372gitlab # [ 236.590352] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"757ff6b5ee9788ab5947f42e","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-757ff6b5ee9788ab5947f42e: done: 0.015264 sec","job_status":"done","queue_duration_s":2.195884,"scheduling_latency_s":2.195901,"redis_calls":13,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015264,"completed_at":"2026-08-15T23:45:21.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 236.628915] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa9c10eec4e53a95a15b8d40","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa9c10eec4e53a95a15b8d40: start","job_status":"start","queue_duration_s":2.212654,"scheduling_latency_s":2.212671}1374gitlab # [ 236.641279] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa9c10eec4e53a95a15b8d40","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa9c10eec4e53a95a15b8d40: done: 0.015395 sec","job_status":"done","queue_duration_s":2.212654,"scheduling_latency_s":2.212671,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015395,"completed_at":"2026-08-15T23:45:21.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 236.680178] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae486c85701a1a306d0315e3","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae486c85701a1a306d0315e3: start","job_status":"start","queue_duration_s":2.229491,"scheduling_latency_s":2.229508}1376gitlab # [ 236.692162] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae486c85701a1a306d0315e3","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae486c85701a1a306d0315e3: done: 0.015111 sec","job_status":"done","queue_duration_s":2.229491,"scheduling_latency_s":2.229508,"redis_calls":13,"redis_duration_s":0.001895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015111,"completed_at":"2026-08-15T23:45:21.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 236.730956] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7d1bf933282b1d35bd66c63","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7d1bf933282b1d35bd66c63: start","job_status":"start","queue_duration_s":2.245717,"scheduling_latency_s":2.245733}1378gitlab # [ 236.744367] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7d1bf933282b1d35bd66c63","created_at":"2026-08-15T23:45:19.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-541837362cdd4357","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"35407aa309c67a35f94ba96b57adacfd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:19.257Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7d1bf933282b1d35bd66c63: done: 0.015949 sec","job_status":"done","queue_duration_s":2.245717,"scheduling_latency_s":2.245733,"redis_calls":13,"redis_duration_s":0.001556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015949,"completed_at":"2026-08-15T23:45:21.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 236.783219] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.520Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"597aa6d6cec9110dfe8c7b57","created_at":"2026-08-15T23:45:20.537Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-0db275b18a114589","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:20.551Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-597aa6d6cec9110dfe8c7b57: start","job_status":"start","queue_duration_s":0.969223,"scheduling_latency_s":0.96924}1380gitlab # [ 236.795673] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.539Z","message":"No existing merge request to be cleaned up."}1381gitlab # [ 236.797438] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.559Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"597aa6d6cec9110dfe8c7b57","created_at":"2026-08-15T23:45:20.537Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-0db275b18a114589","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:20.551Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-597aa6d6cec9110dfe8c7b57: done: 0.038766 sec","job_status":"done","queue_duration_s":0.969223,"scheduling_latency_s":0.96924,"redis_calls":13,"redis_duration_s":0.001943,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027608,"duration_s":0.038766,"completed_at":"2026-08-15T23:45:21.559Z","load_balancing_strategy":"primary","db_duration_s":0.006008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 236.837355] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.560Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e2bdf0007884a613750af2c4","created_at":"2026-08-15T23:45:20.537Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-0db275b18a114589","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:20.551Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e2bdf0007884a613750af2c4: start","job_status":"start","queue_duration_s":1.00912,"scheduling_latency_s":1.009137}1383gitlab # [ 236.849578] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.572Z","message":"No existing merge request to be cleaned up."}1384gitlab # [ 236.851199] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.581Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e2bdf0007884a613750af2c4","created_at":"2026-08-15T23:45:20.537Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-0db275b18a114589","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:20.551Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e2bdf0007884a613750af2c4: done: 0.02058 sec","job_status":"done","queue_duration_s":1.00912,"scheduling_latency_s":1.009137,"redis_calls":10,"redis_duration_s":0.001375,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02058,"completed_at":"2026-08-15T23:45:21.581Z","load_balancing_strategy":"primary","db_duration_s":0.00303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 236.889228] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.582Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"99e3fa473fea6f5b1213990c","created_at":"2026-08-15T23:45:20.537Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-0db275b18a114589","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:20.551Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-99e3fa473fea6f5b1213990c: start","job_status":"start","queue_duration_s":1.030773,"scheduling_latency_s":1.03079}1386gitlab # [ 236.901147] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.593Z","message":"No existing merge request to be cleaned up."}1387gitlab # [ 236.902762] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.602Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"99e3fa473fea6f5b1213990c","created_at":"2026-08-15T23:45:20.537Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-0db275b18a114589","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:20.551Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-99e3fa473fea6f5b1213990c: done: 0.020451 sec","job_status":"done","queue_duration_s":1.030773,"scheduling_latency_s":1.03079,"redis_calls":10,"redis_duration_s":0.001416,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00081,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020451,"completed_at":"2026-08-15T23:45:21.602Z","load_balancing_strategy":"primary","db_duration_s":0.002416,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 236.941889] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.603Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5065b38271403077700c27db","created_at":"2026-08-15T23:45:20.537Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-0db275b18a114589","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:20.551Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5065b38271403077700c27db: start","job_status":"start","queue_duration_s":1.052257,"scheduling_latency_s":1.052274}1389gitlab # [ 236.954200] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.615Z","message":"No existing merge request to be cleaned up."}1390gitlab # [ 236.955835] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:45:21.625Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5065b38271403077700c27db","created_at":"2026-08-15T23:45:20.537Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-0db275b18a114589","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ce721a5793b06c5cb10845ed1ce397c9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:45:20.551Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5065b38271403077700c27db: done: 0.021916 sec","job_status":"done","queue_duration_s":1.052257,"scheduling_latency_s":1.052274,"redis_calls":10,"redis_duration_s":0.001404,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000787,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021916,"completed_at":"2026-08-15T23:45:21.625Z","load_balancing_strategy":"primary","db_duration_s":0.002132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 266.664283] setup-gitlab-start[2916]: W, [2026-08-15T23:45:53.550910 #2916] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1392gitlab # [ 278.922636] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:05.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0e4f58c7b917b98ad541473d","created_at":"2026-08-15T23:46:05.792Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1f39dc37b2f111938b681eec75b6b45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:05.805Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0e4f58c7b917b98ad541473d: start","job_status":"start","queue_duration_s":0.002971,"scheduling_latency_s":0.003018}1393gitlab # [ 278.940458] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:05.828Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1394gitlab # [ 279.053779] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:05.940Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0e4f58c7b917b98ad541473d","created_at":"2026-08-15T23:46:05.792Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1f39dc37b2f111938b681eec75b6b45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:05.805Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0e4f58c7b917b98ad541473d: done: 0.131951 sec","job_status":"done","queue_duration_s":0.002971,"scheduling_latency_s":0.003018,"redis_calls":7,"redis_duration_s":0.009984,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003512,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006472,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.131951,"completed_at":"2026-08-15T23:46:05.940Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 279.141706] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:05.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"384f47e2fba78bb695463775","created_at":"2026-08-15T23:46:05.832Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd80408e31ce000759a74a9292b6924c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:46:05.837Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-384f47e2fba78bb695463775: start","job_status":"start","queue_duration_s":0.11704,"scheduling_latency_s":0.117092}1396gitlab # [ 279.158361] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.023Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1397gitlab # [ 279.179475] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"384f47e2fba78bb695463775","created_at":"2026-08-15T23:46:05.832Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd80408e31ce000759a74a9292b6924c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T23:46:05.837Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-384f47e2fba78bb695463775: done: 0.111345 sec","job_status":"done","queue_duration_s":0.11704,"scheduling_latency_s":0.117092,"redis_calls":8,"redis_duration_s":0.06336,"redis_read_bytes":9,"redis_write_bytes":810,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.061264,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":552,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002096,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.111345,"completed_at":"2026-08-15T23:46:06.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 279.249878] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.069Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4f11248e0412b7e1a9724e35","created_at":"2026-08-15T23:46:05.853Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"307c432e447dde29d84c8942048b30c9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:05.860Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4f11248e0412b7e1a9724e35: start","job_status":"start","queue_duration_s":0.208795,"scheduling_latency_s":0.208846}1399gitlab # [ 279.270358] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4f11248e0412b7e1a9724e35","created_at":"2026-08-15T23:46:05.853Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"307c432e447dde29d84c8942048b30c9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:05.860Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4f11248e0412b7e1a9724e35: done: 0.060621 sec","job_status":"done","queue_duration_s":0.208795,"scheduling_latency_s":0.208846,"redis_calls":11,"redis_duration_s":0.0040360000000000005,"redis_read_bytes":136,"redis_write_bytes":1288,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00221,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001536,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01608682,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.060621,"completed_at":"2026-08-15T23:46:06.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00909,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1400gitlab # [ 279.319145] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.136Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4efa52b33fd28118b853b9d8","created_at":"2026-08-15T23:46:05.903Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f69915ee7aec02f2b451f50475a5befa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:05.917Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4efa52b33fd28118b853b9d8: start","job_status":"start","queue_duration_s":0.219093,"scheduling_latency_s":0.219134}1401gitlab # [ 279.476491] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4efa52b33fd28118b853b9d8","created_at":"2026-08-15T23:46:05.903Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f69915ee7aec02f2b451f50475a5befa","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:05.917Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4efa52b33fd28118b853b9d8: done: 0.226875 sec","job_status":"done","queue_duration_s":0.219093,"scheduling_latency_s":0.219134,"redis_calls":9,"redis_duration_s":0.01754,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003472,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.014068,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.115,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.115,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.01335358,"exclusive_lock_hold_duration_s":0.07394404,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.226875,"completed_at":"2026-08-15T23:46:06.362Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.135645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 279.567120] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"381d823adc21460dca414931","created_at":"2026-08-15T23:46:05.934Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d2d6115e58c3eb1392b93c24cc3c072","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:05.953Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-381d823adc21460dca414931: start","job_status":"start","queue_duration_s":0.43486,"scheduling_latency_s":0.434919}1403gitlab # [ 279.697641] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"381d823adc21460dca414931","created_at":"2026-08-15T23:46:05.934Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d2d6115e58c3eb1392b93c24cc3c072","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:05.953Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-381d823adc21460dca414931: done: 0.196226 sec","job_status":"done","queue_duration_s":0.43486,"scheduling_latency_s":0.434919,"redis_calls":12,"redis_duration_s":0.010786,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001464,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00335,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0022294,"exclusive_lock_hold_duration_s":0.03352806,"duration_s":0.196226,"completed_at":"2026-08-15T23:46:06.584Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 279.788115] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"74e8b52b3e3030df5c21d8a4","created_at":"2026-08-15T23:46:06.018Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a3a650e020414be6d0fa107e9d36b41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.032Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-74e8b52b3e3030df5c21d8a4: start","job_status":"start","queue_duration_s":0.562793,"scheduling_latency_s":0.562839}1405gitlab # [ 279.805861] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"74e8b52b3e3030df5c21d8a4","created_at":"2026-08-15T23:46:06.018Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a3a650e020414be6d0fa107e9d36b41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.032Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-74e8b52b3e3030df5c21d8a4: done: 0.090665 sec","job_status":"done","queue_duration_s":0.562793,"scheduling_latency_s":0.562839,"redis_calls":14,"redis_duration_s":0.027404,"redis_read_bytes":901,"redis_write_bytes":1253,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.015103,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":477,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009036,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090665,"completed_at":"2026-08-15T23:46:06.686Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 279.849326] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"b7343d5446cd78cba7e327f5","created_at":"2026-08-15T23:46:06.044Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41357336eb66b5f5ae55db05caf75a75","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.139Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-b7343d5446cd78cba7e327f5: start","job_status":"start","queue_duration_s":0.550191,"scheduling_latency_s":0.550237}1407gitlab # [ 279.897860] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.784Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"b7343d5446cd78cba7e327f5","created_at":"2026-08-15T23:46:06.044Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41357336eb66b5f5ae55db05caf75a75","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.139Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-b7343d5446cd78cba7e327f5: done: 0.094918 sec","job_status":"done","queue_duration_s":0.550191,"scheduling_latency_s":0.550237,"redis_calls":12,"redis_duration_s":0.005201,"redis_read_bytes":11,"redis_write_bytes":1481,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000939,"exclusive_lock_hold_duration_s":0.04817438,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.094918,"completed_at":"2026-08-15T23:46:06.784Z","load_balancing_strategy":"primary","db_duration_s":0.020726,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 279.963948] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.788Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f198bf9e198c3da84d6a3dca","created_at":"2026-08-15T23:46:06.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f48634f8ae6805e6e2fd35816a7f0a81","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.180Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f198bf9e198c3da84d6a3dca: start","job_status":"start","queue_duration_s":0.607932,"scheduling_latency_s":0.607969}1409gitlab # [ 279.978712] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.835Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f198bf9e198c3da84d6a3dca","created_at":"2026-08-15T23:46:06.170Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f48634f8ae6805e6e2fd35816a7f0a81","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.180Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f198bf9e198c3da84d6a3dca: done: 0.047349 sec","job_status":"done","queue_duration_s":0.607932,"scheduling_latency_s":0.607969,"redis_calls":14,"redis_duration_s":0.004848,"redis_read_bytes":266,"redis_write_bytes":1306,"redis_cache_calls":2,"redis_cache_duration_s":0.000795,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001228,"redis_feature_flag_read_bytes":258,"redis_feature_flag_write_bytes":437,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009118,"duration_s":0.047349,"completed_at":"2026-08-15T23:46:06.835Z","load_balancing_strategy":"primary","db_duration_s":0.000705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 280.021162] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3a8dee422f88c55cf55c731f","created_at":"2026-08-15T23:46:06.185Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7efbf5a6e76e4d2517dc573d0fd7d49b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.189Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3a8dee422f88c55cf55c731f: start","job_status":"start","queue_duration_s":0.649337,"scheduling_latency_s":0.64939}1411gitlab # [ 280.040693] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3a8dee422f88c55cf55c731f","created_at":"2026-08-15T23:46:06.185Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7efbf5a6e76e4d2517dc573d0fd7d49b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.189Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3a8dee422f88c55cf55c731f: done: 0.088692 sec","job_status":"done","queue_duration_s":0.649337,"scheduling_latency_s":0.64939,"redis_calls":9,"redis_duration_s":0.003743,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001789,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00119754,"exclusive_lock_hold_duration_s":0.05148394,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.088692,"completed_at":"2026-08-15T23:46:06.927Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025383,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 280.084768] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.930Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7b7ba82e0c9d58e6612599e9","created_at":"2026-08-15T23:46:06.207Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1e06b740b512983a7cee60c1e86803e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.210Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7b7ba82e0c9d58e6612599e9: start","job_status":"start","queue_duration_s":0.720078,"scheduling_latency_s":0.720123}1413gitlab # [ 280.099187] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.948Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1414gitlab # [ 280.102478] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.957Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7b7ba82e0c9d58e6612599e9","created_at":"2026-08-15T23:46:06.207Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1e06b740b512983a7cee60c1e86803e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.210Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7b7ba82e0c9d58e6612599e9: done: 0.027163 sec","job_status":"done","queue_duration_s":0.720078,"scheduling_latency_s":0.720123,"redis_calls":7,"redis_duration_s":0.002285,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001623,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027163,"completed_at":"2026-08-15T23:46:06.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 280.143271] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:06.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"87251c9bb037ecf030915dd6","created_at":"2026-08-15T23:46:06.214Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.221Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-87251c9bb037ecf030915dd6: start","job_status":"start","queue_duration_s":0.738562,"scheduling_latency_s":0.73859}1416gitlab # [ 280.269108] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:07.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"87251c9bb037ecf030915dd6","created_at":"2026-08-15T23:46:06.214Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.221Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-87251c9bb037ecf030915dd6: done: 0.195047 sec","job_status":"done","queue_duration_s":0.738562,"scheduling_latency_s":0.73859,"redis_calls":60,"redis_duration_s":0.028574000000000002,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.002752,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.024812,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.167239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.195047,"completed_at":"2026-08-15T23:46:07.155Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 280.356275] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:07.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9e5e6b20efaa5b07d22a6209","created_at":"2026-08-15T23:46:06.225Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6f47e8ac95e881f595723d573c0f022","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.228Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9e5e6b20efaa5b07d22a6209: start","job_status":"start","queue_duration_s":0.930544,"scheduling_latency_s":0.930578}1418gitlab # [ 280.765557] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:07.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9e5e6b20efaa5b07d22a6209","created_at":"2026-08-15T23:46:06.225Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6f47e8ac95e881f595723d573c0f022","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.228Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9e5e6b20efaa5b07d22a6209: done: 0.492714 sec","job_status":"done","queue_duration_s":0.930544,"scheduling_latency_s":0.930578,"redis_calls":11,"redis_duration_s":0.004835000000000001,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000912,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.093,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.093,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.373854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00128886,"exclusive_lock_hold_duration_s":0.44535668,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.492714,"completed_at":"2026-08-15T23:46:07.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.13302,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 280.863738] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:07.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2b42673c3e6b013858f6852f","created_at":"2026-08-15T23:46:06.242Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"406cfca5008ac96ba8f077e525482bd7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.248Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2b42673c3e6b013858f6852f: start","job_status":"start","queue_duration_s":1.406599,"scheduling_latency_s":1.406619}1420gitlab # [ 281.163049] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2b42673c3e6b013858f6852f","created_at":"2026-08-15T23:46:06.242Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"406cfca5008ac96ba8f077e525482bd7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.248Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2b42673c3e6b013858f6852f: done: 0.394595 sec","job_status":"done","queue_duration_s":1.406599,"scheduling_latency_s":1.406619,"redis_calls":562,"redis_duration_s":0.095288,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001523,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.093765,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.343211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.394595,"completed_at":"2026-08-15T23:46:08.049Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 281.206989] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.053Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"fe3ec7f503cf767e46fa3738","created_at":"2026-08-15T23:46:06.262Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b420f9c1bdc66f253b528d3aeec85535","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.267Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-fe3ec7f503cf767e46fa3738: start","job_status":"start","queue_duration_s":1.78609,"scheduling_latency_s":1.786141}1422gitlab # [ 281.223844] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"fe3ec7f503cf767e46fa3738","created_at":"2026-08-15T23:46:06.262Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b420f9c1bdc66f253b528d3aeec85535","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.267Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-fe3ec7f503cf767e46fa3738: done: 0.057327 sec","job_status":"done","queue_duration_s":1.78609,"scheduling_latency_s":1.786141,"redis_calls":7,"redis_duration_s":0.0034289999999999998,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002402,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.057327,"completed_at":"2026-08-15T23:46:08.110Z","load_balancing_strategy":"primary","db_duration_s":0.018841,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 281.265766] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.114Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"432922dbbf798edbba3f3308","created_at":"2026-08-15T23:46:06.276Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e665ea07f0bb982e2c919e1ab70a7b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:46:06.279Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-432922dbbf798edbba3f3308: start","job_status":"start","queue_duration_s":1.83474,"scheduling_latency_s":1.834784}1424gitlab # [ 281.279244] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.135Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1425gitlab # [ 281.283168] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.146Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"432922dbbf798edbba3f3308","created_at":"2026-08-15T23:46:06.276Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e665ea07f0bb982e2c919e1ab70a7b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T23:46:06.279Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-432922dbbf798edbba3f3308: done: 0.031967 sec","job_status":"done","queue_duration_s":1.83474,"scheduling_latency_s":1.834784,"redis_calls":7,"redis_duration_s":0.0027600000000000003,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001974,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000786,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031967,"completed_at":"2026-08-15T23:46:08.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 281.324212] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.149Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"13195aaaacb23d0881680c92","created_at":"2026-08-15T23:46:06.288Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55b80ade830c5e717c42cbeeba6fbe14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.291Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-13195aaaacb23d0881680c92: start","job_status":"start","queue_duration_s":1.858022,"scheduling_latency_s":1.858054}1427gitlab # [ 281.338686] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.165Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1428gitlab # [ 281.342264] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"13195aaaacb23d0881680c92","created_at":"2026-08-15T23:46:06.288Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55b80ade830c5e717c42cbeeba6fbe14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.291Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-13195aaaacb23d0881680c92: done: 0.025359 sec","job_status":"done","queue_duration_s":1.858022,"scheduling_latency_s":1.858054,"redis_calls":7,"redis_duration_s":0.002494,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025359,"completed_at":"2026-08-15T23:46:08.174Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 281.382944] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"62f5f309ca0a6facd52a5023","created_at":"2026-08-15T23:46:06.295Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55d54bfcad656f98923924b0e25ba0a9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.300Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-62f5f309ca0a6facd52a5023: start","job_status":"start","queue_duration_s":1.877189,"scheduling_latency_s":1.87722}1430gitlab # [ 281.397430] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"62f5f309ca0a6facd52a5023","created_at":"2026-08-15T23:46:06.295Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55d54bfcad656f98923924b0e25ba0a9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.300Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-62f5f309ca0a6facd52a5023: done: 0.027175 sec","job_status":"done","queue_duration_s":1.877189,"scheduling_latency_s":1.87722,"redis_calls":7,"redis_duration_s":0.0023970000000000003,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027175,"completed_at":"2026-08-15T23:46:08.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002204,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 281.437915] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.207Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"197008f035a7d675a9884009","created_at":"2026-08-15T23:46:06.310Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14850449fac978ad3220861cd5585475","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.313Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-197008f035a7d675a9884009: start","job_status":"start","queue_duration_s":1.893514,"scheduling_latency_s":1.893543}1432gitlab # [ 281.452141] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.237Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"197008f035a7d675a9884009","created_at":"2026-08-15T23:46:06.310Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14850449fac978ad3220861cd5585475","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.313Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-197008f035a7d675a9884009: done: 0.030751 sec","job_status":"done","queue_duration_s":1.893514,"scheduling_latency_s":1.893543,"redis_calls":7,"redis_duration_s":0.002286,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000613,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030751,"completed_at":"2026-08-15T23:46:08.237Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006468,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 281.492269] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"edf81fcea9d321e714a27253","created_at":"2026-08-15T23:46:06.321Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"911811787b22934e620a9c700e42f3de","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.336Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-edf81fcea9d321e714a27253: start","job_status":"start","queue_duration_s":1.903762,"scheduling_latency_s":1.903785}1434gitlab # [ 281.507835] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"edf81fcea9d321e714a27253","created_at":"2026-08-15T23:46:06.321Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"911811787b22934e620a9c700e42f3de","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.336Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-edf81fcea9d321e714a27253: done: 0.040829 sec","job_status":"done","queue_duration_s":1.903762,"scheduling_latency_s":1.903785,"redis_calls":10,"redis_duration_s":0.003312,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00075,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001938,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000624,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004491,"duration_s":0.040829,"completed_at":"2026-08-15T23:46:08.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006873,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 281.550578] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.282Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"510f0272dec89fd8f73607a5","created_at":"2026-08-15T23:46:06.349Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.357Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-510f0272dec89fd8f73607a5: start","job_status":"start","queue_duration_s":1.924669,"scheduling_latency_s":1.924691}1436gitlab # [ 281.563952] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.316Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"510f0272dec89fd8f73607a5","created_at":"2026-08-15T23:46:06.349Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.357Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-510f0272dec89fd8f73607a5: done: 0.033699 sec","job_status":"done","queue_duration_s":1.924669,"scheduling_latency_s":1.924691,"redis_calls":14,"redis_duration_s":0.003958,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000407,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002591,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033699,"completed_at":"2026-08-15T23:46:08.316Z","load_balancing_strategy":"primary","db_duration_s":0.002188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 281.605374] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.317Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"cf2f763cec6800049443d81f","created_at":"2026-08-15T23:46:06.389Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d06365e317dd24bc2d3ae55c25e333ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.398Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-cf2f763cec6800049443d81f: start","job_status":"start","queue_duration_s":1.919461,"scheduling_latency_s":1.919481}1438gitlab # [ 281.620099] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.326Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1439gitlab # [ 281.624054] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.332Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"cf2f763cec6800049443d81f","created_at":"2026-08-15T23:46:06.389Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d06365e317dd24bc2d3ae55c25e333ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.398Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-cf2f763cec6800049443d81f: done: 0.014705 sec","job_status":"done","queue_duration_s":1.919461,"scheduling_latency_s":1.919481,"redis_calls":7,"redis_duration_s":0.001829,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00132,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014705,"completed_at":"2026-08-15T23:46:08.332Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 281.665111] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d8c60f531253c78e88b2d6b2","created_at":"2026-08-15T23:46:06.463Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"564fcad72a8e9c284ddd3062fa4e9b58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.472Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d8c60f531253c78e88b2d6b2: start","job_status":"start","queue_duration_s":1.861962,"scheduling_latency_s":1.861979}1441gitlab # [ 281.678938] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d8c60f531253c78e88b2d6b2","created_at":"2026-08-15T23:46:06.463Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"564fcad72a8e9c284ddd3062fa4e9b58","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.472Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d8c60f531253c78e88b2d6b2: done: 0.01873 sec","job_status":"done","queue_duration_s":1.861962,"scheduling_latency_s":1.861979,"redis_calls":9,"redis_duration_s":0.002844,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057734,"exclusive_lock_hold_duration_s":0.00386044,"duration_s":0.01873,"completed_at":"2026-08-15T23:46:08.352Z","load_balancing_strategy":"primary","db_duration_s":0.001667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 281.720585] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.354Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e4410eb2bb578d491f363973","created_at":"2026-08-15T23:46:06.572Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3797f0487c065b3ce7abe81b449d9b44","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:46:06.579Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e4410eb2bb578d491f363973: start","job_status":"start","queue_duration_s":1.775471,"scheduling_latency_s":1.775489}1443gitlab # [ 281.733748] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e4410eb2bb578d491f363973","created_at":"2026-08-15T23:46:06.572Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3797f0487c065b3ce7abe81b449d9b44","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T23:46:06.579Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e4410eb2bb578d491f363973: done: 0.022748 sec","job_status":"done","queue_duration_s":1.775471,"scheduling_latency_s":1.775489,"redis_calls":7,"redis_duration_s":0.0018960000000000001,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001389,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000507,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022748,"completed_at":"2026-08-15T23:46:08.377Z","load_balancing_strategy":"primary","db_duration_s":0.002906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 281.773331] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.378Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c24624f25690331fec5b4cf1","created_at":"2026-08-15T23:46:06.606Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"824ad354af17edd6a9da38a4982565d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.612Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c24624f25690331fec5b4cf1: start","job_status":"start","queue_duration_s":1.766655,"scheduling_latency_s":1.766672}1445gitlab # [ 281.788275] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c24624f25690331fec5b4cf1","created_at":"2026-08-15T23:46:06.606Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"824ad354af17edd6a9da38a4982565d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.612Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c24624f25690331fec5b4cf1: done: 0.013428 sec","job_status":"done","queue_duration_s":1.766655,"scheduling_latency_s":1.766672,"redis_calls":7,"redis_duration_s":0.001739,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013428,"completed_at":"2026-08-15T23:46:08.392Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 281.829744] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.393Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"38b70f3a56357697207054dc","created_at":"2026-08-15T23:46:06.642Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84312c8df37e8dccfddee76a7e0c29ed","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.653Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-38b70f3a56357697207054dc: start","job_status":"start","queue_duration_s":1.73985,"scheduling_latency_s":1.739927}1447gitlab # [ 281.844290] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.411Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"38b70f3a56357697207054dc","created_at":"2026-08-15T23:46:06.642Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-1de5b8df241f4817","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84312c8df37e8dccfddee76a7e0c29ed","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:06.653Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-38b70f3a56357697207054dc: done: 0.01774 sec","job_status":"done","queue_duration_s":1.73985,"scheduling_latency_s":1.739927,"redis_calls":9,"redis_duration_s":0.002516,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055062,"exclusive_lock_hold_duration_s":0.00367254,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.01774,"completed_at":"2026-08-15T23:46:08.411Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002048,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 281.886567] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b8997add71c0edc68b4807c","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b8997add71c0edc68b4807c: start","job_status":"start","queue_duration_s":1.283073,"scheduling_latency_s":1.28309}1449gitlab # [ 281.899338] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b8997add71c0edc68b4807c","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b8997add71c0edc68b4807c: done: 0.015521 sec","job_status":"done","queue_duration_s":1.283073,"scheduling_latency_s":1.28309,"redis_calls":13,"redis_duration_s":0.002885,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015521,"completed_at":"2026-08-15T23:46:08.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 281.941069] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d7b292d385caf1553350af6","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d7b292d385caf1553350af6: start","job_status":"start","queue_duration_s":1.300013,"scheduling_latency_s":1.300029}1451gitlab # [ 281.953387] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d7b292d385caf1553350af6","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d7b292d385caf1553350af6: done: 0.015469 sec","job_status":"done","queue_duration_s":1.300013,"scheduling_latency_s":1.300029,"redis_calls":13,"redis_duration_s":0.003001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015469,"completed_at":"2026-08-15T23:46:08.445Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 281.992700] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd74504c8d9ecd1831c4c153","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd74504c8d9ecd1831c4c153: start","job_status":"start","queue_duration_s":1.316863,"scheduling_latency_s":1.31688}1453gitlab # [ 282.005127] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd74504c8d9ecd1831c4c153","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd74504c8d9ecd1831c4c153: done: 0.015043 sec","job_status":"done","queue_duration_s":1.316863,"scheduling_latency_s":1.31688,"redis_calls":13,"redis_duration_s":0.002759,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015043,"completed_at":"2026-08-15T23:46:08.461Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 282.044638] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ac40e5d3d87666cea8804d4","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ac40e5d3d87666cea8804d4: start","job_status":"start","queue_duration_s":1.333327,"scheduling_latency_s":1.333342}1455gitlab # [ 282.057188] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ac40e5d3d87666cea8804d4","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ac40e5d3d87666cea8804d4: done: 0.015422 sec","job_status":"done","queue_duration_s":1.333327,"scheduling_latency_s":1.333342,"redis_calls":13,"redis_duration_s":0.002935,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015422,"completed_at":"2026-08-15T23:46:08.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 282.096314] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4428f3c8d727d3f5c681e6c1","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4428f3c8d727d3f5c681e6c1: start","job_status":"start","queue_duration_s":1.350009,"scheduling_latency_s":1.350026}1457gitlab # [ 282.109560] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4428f3c8d727d3f5c681e6c1","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4428f3c8d727d3f5c681e6c1: done: 0.014708 sec","job_status":"done","queue_duration_s":1.350009,"scheduling_latency_s":1.350026,"redis_calls":13,"redis_duration_s":0.002529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014708,"completed_at":"2026-08-15T23:46:08.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 282.148987] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7f4960cf75d86a237b9533e","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7f4960cf75d86a237b9533e: start","job_status":"start","queue_duration_s":1.366059,"scheduling_latency_s":1.366093}1459gitlab # [ 282.161492] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7f4960cf75d86a237b9533e","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7f4960cf75d86a237b9533e: done: 0.014997 sec","job_status":"done","queue_duration_s":1.366059,"scheduling_latency_s":1.366093,"redis_calls":13,"redis_duration_s":0.002637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001672,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014997,"completed_at":"2026-08-15T23:46:08.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 282.200989] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dc5da2bbddbc0455b446fe9","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dc5da2bbddbc0455b446fe9: start","job_status":"start","queue_duration_s":1.38235,"scheduling_latency_s":1.382366}1461gitlab # [ 282.213577] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dc5da2bbddbc0455b446fe9","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dc5da2bbddbc0455b446fe9: done: 0.019435 sec","job_status":"done","queue_duration_s":1.38235,"scheduling_latency_s":1.382366,"redis_calls":13,"redis_duration_s":0.006392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005264,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019435,"completed_at":"2026-08-15T23:46:08.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 282.252631] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86667747e0e4c15ff892809c","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86667747e0e4c15ff892809c: start","job_status":"start","queue_duration_s":1.403288,"scheduling_latency_s":1.403305}1463gitlab # [ 282.264931] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86667747e0e4c15ff892809c","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86667747e0e4c15ff892809c: done: 0.015588 sec","job_status":"done","queue_duration_s":1.403288,"scheduling_latency_s":1.403305,"redis_calls":13,"redis_duration_s":0.002667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001633,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015588,"completed_at":"2026-08-15T23:46:08.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 282.303539] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06fc9a57a388e545dbda22d","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06fc9a57a388e545dbda22d: start","job_status":"start","queue_duration_s":1.420388,"scheduling_latency_s":1.420403}1465gitlab # [ 282.317009] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06fc9a57a388e545dbda22d","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06fc9a57a388e545dbda22d: done: 0.015094 sec","job_status":"done","queue_duration_s":1.420388,"scheduling_latency_s":1.420403,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015094,"completed_at":"2026-08-15T23:46:08.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 282.355928] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdf5808dae359353ad68fef2","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdf5808dae359353ad68fef2: start","job_status":"start","queue_duration_s":1.436581,"scheduling_latency_s":1.436598}1467gitlab # [ 282.368285] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdf5808dae359353ad68fef2","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdf5808dae359353ad68fef2: done: 0.014132 sec","job_status":"done","queue_duration_s":1.436581,"scheduling_latency_s":1.436598,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014132,"completed_at":"2026-08-15T23:46:08.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 282.406968] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"507f0c49583a859a103e6d32","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-507f0c49583a859a103e6d32: start","job_status":"start","queue_duration_s":1.451865,"scheduling_latency_s":1.451884}1469gitlab # [ 282.419402] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"507f0c49583a859a103e6d32","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-507f0c49583a859a103e6d32: done: 0.014208 sec","job_status":"done","queue_duration_s":1.451865,"scheduling_latency_s":1.451884,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014208,"completed_at":"2026-08-15T23:46:08.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 282.459290] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f40f7229d71b77c47d4205f3","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f40f7229d71b77c47d4205f3: start","job_status":"start","queue_duration_s":1.467232,"scheduling_latency_s":1.467249}1471gitlab # [ 282.471873] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f40f7229d71b77c47d4205f3","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f40f7229d71b77c47d4205f3: done: 0.014074 sec","job_status":"done","queue_duration_s":1.467232,"scheduling_latency_s":1.467249,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014074,"completed_at":"2026-08-15T23:46:08.611Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 282.510992] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9720a4e2ad46bd966ece9eca","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9720a4e2ad46bd966ece9eca: start","job_status":"start","queue_duration_s":1.482398,"scheduling_latency_s":1.482415}1473gitlab # [ 282.524463] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9720a4e2ad46bd966ece9eca","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9720a4e2ad46bd966ece9eca: done: 0.014153 sec","job_status":"done","queue_duration_s":1.482398,"scheduling_latency_s":1.482415,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014153,"completed_at":"2026-08-15T23:46:08.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 282.563064] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a50b4878cb0d5145b5fc8f0","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a50b4878cb0d5145b5fc8f0: start","job_status":"start","queue_duration_s":1.497646,"scheduling_latency_s":1.497663}1475gitlab # [ 282.575605] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a50b4878cb0d5145b5fc8f0","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a50b4878cb0d5145b5fc8f0: done: 0.014228 sec","job_status":"done","queue_duration_s":1.497646,"scheduling_latency_s":1.497663,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014228,"completed_at":"2026-08-15T23:46:08.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 282.614459] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85ad6d5d18748f1b8853b673","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85ad6d5d18748f1b8853b673: start","job_status":"start","queue_duration_s":1.513043,"scheduling_latency_s":1.51306}1477gitlab # [ 282.626620] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85ad6d5d18748f1b8853b673","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85ad6d5d18748f1b8853b673: done: 0.014497 sec","job_status":"done","queue_duration_s":1.513043,"scheduling_latency_s":1.51306,"redis_calls":13,"redis_duration_s":0.0015110000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014497,"completed_at":"2026-08-15T23:46:08.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 282.665561] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4defa65ce9d7be49b1216eb0","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4defa65ce9d7be49b1216eb0: start","job_status":"start","queue_duration_s":1.52867,"scheduling_latency_s":1.528688}1479gitlab # [ 282.677796] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4defa65ce9d7be49b1216eb0","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4defa65ce9d7be49b1216eb0: done: 0.013993 sec","job_status":"done","queue_duration_s":1.52867,"scheduling_latency_s":1.528688,"redis_calls":13,"redis_duration_s":0.001452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013993,"completed_at":"2026-08-15T23:46:08.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 282.716986] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9fa839e86f2dfc39a35a6bd","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9fa839e86f2dfc39a35a6bd: start","job_status":"start","queue_duration_s":1.5437,"scheduling_latency_s":1.543717}1481gitlab # [ 282.730247] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9fa839e86f2dfc39a35a6bd","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9fa839e86f2dfc39a35a6bd: done: 0.01381 sec","job_status":"done","queue_duration_s":1.5437,"scheduling_latency_s":1.543717,"redis_calls":13,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01381,"completed_at":"2026-08-15T23:46:08.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 282.769446] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98d3f120a1b6d4f7367fc89b","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98d3f120a1b6d4f7367fc89b: start","job_status":"start","queue_duration_s":1.55867,"scheduling_latency_s":1.558687}1483gitlab # [ 282.781874] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98d3f120a1b6d4f7367fc89b","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98d3f120a1b6d4f7367fc89b: done: 0.014132 sec","job_status":"done","queue_duration_s":1.55867,"scheduling_latency_s":1.558687,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014132,"completed_at":"2026-08-15T23:46:08.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 282.820603] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28f45f565d90fc09d9aff3df","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28f45f565d90fc09d9aff3df: start","job_status":"start","queue_duration_s":1.573844,"scheduling_latency_s":1.573861}1485gitlab # [ 282.832876] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28f45f565d90fc09d9aff3df","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28f45f565d90fc09d9aff3df: done: 0.014009 sec","job_status":"done","queue_duration_s":1.573844,"scheduling_latency_s":1.573861,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014009,"completed_at":"2026-08-15T23:46:08.717Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 282.871596] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee3bf13dcb70ee4d5a842e57","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee3bf13dcb70ee4d5a842e57: start","job_status":"start","queue_duration_s":1.588933,"scheduling_latency_s":1.588949}1487gitlab # [ 282.884136] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee3bf13dcb70ee4d5a842e57","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee3bf13dcb70ee4d5a842e57: done: 0.014211 sec","job_status":"done","queue_duration_s":1.588933,"scheduling_latency_s":1.588949,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014211,"completed_at":"2026-08-15T23:46:08.733Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 282.922876] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e091ae686415e55829e98792","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e091ae686415e55829e98792: start","job_status":"start","queue_duration_s":1.604236,"scheduling_latency_s":1.604253}1489gitlab # [ 282.936317] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e091ae686415e55829e98792","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e091ae686415e55829e98792: done: 0.015019 sec","job_status":"done","queue_duration_s":1.604236,"scheduling_latency_s":1.604253,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015019,"completed_at":"2026-08-15T23:46:08.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 282.975356] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46374c098a53b1147b328a05","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46374c098a53b1147b328a05: start","job_status":"start","queue_duration_s":1.620323,"scheduling_latency_s":1.620339}1491gitlab # [ 282.987823] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46374c098a53b1147b328a05","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46374c098a53b1147b328a05: done: 0.014508 sec","job_status":"done","queue_duration_s":1.620323,"scheduling_latency_s":1.620339,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014508,"completed_at":"2026-08-15T23:46:08.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 283.026671] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2608148431402776a1243b4b","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2608148431402776a1243b4b: start","job_status":"start","queue_duration_s":1.635873,"scheduling_latency_s":1.63589}1493gitlab # [ 283.039148] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2608148431402776a1243b4b","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2608148431402776a1243b4b: done: 0.014384 sec","job_status":"done","queue_duration_s":1.635873,"scheduling_latency_s":1.63589,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014384,"completed_at":"2026-08-15T23:46:08.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 283.077962] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7469b0f0c8cdc73729df8c1d","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7469b0f0c8cdc73729df8c1d: start","job_status":"start","queue_duration_s":1.651325,"scheduling_latency_s":1.651342}1495gitlab # [ 283.090305] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7469b0f0c8cdc73729df8c1d","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7469b0f0c8cdc73729df8c1d: done: 0.014244 sec","job_status":"done","queue_duration_s":1.651325,"scheduling_latency_s":1.651342,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014244,"completed_at":"2026-08-15T23:46:08.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 283.129878] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"886b25649457bac2c12a7676","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-886b25649457bac2c12a7676: start","job_status":"start","queue_duration_s":1.666965,"scheduling_latency_s":1.666982}1497gitlab # [ 283.142333] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"886b25649457bac2c12a7676","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-886b25649457bac2c12a7676: done: 0.014427 sec","job_status":"done","queue_duration_s":1.666965,"scheduling_latency_s":1.666982,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014427,"completed_at":"2026-08-15T23:46:08.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 283.181233] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"528d150c8b6b79fb4d97ee19","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-528d150c8b6b79fb4d97ee19: start","job_status":"start","queue_duration_s":1.682494,"scheduling_latency_s":1.682512}1499gitlab # [ 283.193424] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"528d150c8b6b79fb4d97ee19","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-528d150c8b6b79fb4d97ee19: done: 0.01466 sec","job_status":"done","queue_duration_s":1.682494,"scheduling_latency_s":1.682512,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01466,"completed_at":"2026-08-15T23:46:08.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 283.232898] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7c0cbc67b9a4c30a78369ad","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7c0cbc67b9a4c30a78369ad: start","job_status":"start","queue_duration_s":1.698705,"scheduling_latency_s":1.698723}1501gitlab # [ 283.245094] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7c0cbc67b9a4c30a78369ad","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7c0cbc67b9a4c30a78369ad: done: 0.015938 sec","job_status":"done","queue_duration_s":1.698705,"scheduling_latency_s":1.698723,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015938,"completed_at":"2026-08-15T23:46:08.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 283.284098] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03dd8a7fddf21b02a12b2458","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03dd8a7fddf21b02a12b2458: start","job_status":"start","queue_duration_s":1.716286,"scheduling_latency_s":1.716304}1503gitlab # [ 283.296129] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03dd8a7fddf21b02a12b2458","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03dd8a7fddf21b02a12b2458: done: 0.016679 sec","job_status":"done","queue_duration_s":1.716286,"scheduling_latency_s":1.716304,"redis_calls":13,"redis_duration_s":0.001504,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016679,"completed_at":"2026-08-15T23:46:08.862Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 283.336295] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8afc761c04aa160d1302fef8","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8afc761c04aa160d1302fef8: start","job_status":"start","queue_duration_s":1.734651,"scheduling_latency_s":1.734669}1505gitlab # [ 283.348471] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8afc761c04aa160d1302fef8","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8afc761c04aa160d1302fef8: done: 0.015889 sec","job_status":"done","queue_duration_s":1.734651,"scheduling_latency_s":1.734669,"redis_calls":13,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015889,"completed_at":"2026-08-15T23:46:08.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 283.387867] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a045e569988a097cd8483e56","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a045e569988a097cd8483e56: start","job_status":"start","queue_duration_s":1.75218,"scheduling_latency_s":1.752198}1507gitlab # [ 283.400250] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a045e569988a097cd8483e56","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a045e569988a097cd8483e56: done: 0.016161 sec","job_status":"done","queue_duration_s":1.75218,"scheduling_latency_s":1.752198,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016161,"completed_at":"2026-08-15T23:46:08.898Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 283.439362] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"428d984b9f692ecee2c3e204","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-428d984b9f692ecee2c3e204: start","job_status":"start","queue_duration_s":1.770188,"scheduling_latency_s":1.770207}1509gitlab # [ 283.451993] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"428d984b9f692ecee2c3e204","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-428d984b9f692ecee2c3e204: done: 0.01593 sec","job_status":"done","queue_duration_s":1.770188,"scheduling_latency_s":1.770207,"redis_calls":13,"redis_duration_s":0.0020629999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00114,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01593,"completed_at":"2026-08-15T23:46:08.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 283.490881] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5e36ac921249af661f08b36","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5e36ac921249af661f08b36: start","job_status":"start","queue_duration_s":1.787202,"scheduling_latency_s":1.787219}1511gitlab # [ 283.503480] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5e36ac921249af661f08b36","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5e36ac921249af661f08b36: done: 0.019547 sec","job_status":"done","queue_duration_s":1.787202,"scheduling_latency_s":1.787219,"redis_calls":13,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019547,"completed_at":"2026-08-15T23:46:08.936Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 283.543864] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5230f56290382cee22950e3","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5230f56290382cee22950e3: start","job_status":"start","queue_duration_s":1.807849,"scheduling_latency_s":1.807866}1513gitlab # [ 283.556800] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5230f56290382cee22950e3","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5230f56290382cee22950e3: done: 0.014228 sec","job_status":"done","queue_duration_s":1.807849,"scheduling_latency_s":1.807866,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014228,"completed_at":"2026-08-15T23:46:08.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 283.596124] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d9d33b6161aa38e9164bd90","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d9d33b6161aa38e9164bd90: start","job_status":"start","queue_duration_s":1.823216,"scheduling_latency_s":1.823233}1515gitlab # [ 283.608322] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d9d33b6161aa38e9164bd90","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d9d33b6161aa38e9164bd90: done: 0.01417 sec","job_status":"done","queue_duration_s":1.823216,"scheduling_latency_s":1.823233,"redis_calls":13,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01417,"completed_at":"2026-08-15T23:46:08.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 283.647386] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05cc733841cd5a483954d212","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05cc733841cd5a483954d212: start","job_status":"start","queue_duration_s":1.838467,"scheduling_latency_s":1.838485}1517gitlab # [ 283.659958] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05cc733841cd5a483954d212","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05cc733841cd5a483954d212: done: 0.013868 sec","job_status":"done","queue_duration_s":1.838467,"scheduling_latency_s":1.838485,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013868,"completed_at":"2026-08-15T23:46:08.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 283.699432] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102510688ced5b89730736cf","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102510688ced5b89730736cf: start","job_status":"start","queue_duration_s":1.853407,"scheduling_latency_s":1.853425}1519gitlab # [ 283.712115] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102510688ced5b89730736cf","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102510688ced5b89730736cf: done: 0.014139 sec","job_status":"done","queue_duration_s":1.853407,"scheduling_latency_s":1.853425,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014139,"completed_at":"2026-08-15T23:46:08.997Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 283.752294] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:08.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5d5c5941868f9e4d8aba340","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5d5c5941868f9e4d8aba340: start","job_status":"start","queue_duration_s":1.868632,"scheduling_latency_s":1.868649}1521gitlab # [ 283.764292] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5d5c5941868f9e4d8aba340","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5d5c5941868f9e4d8aba340: done: 0.013829 sec","job_status":"done","queue_duration_s":1.868632,"scheduling_latency_s":1.868649,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013829,"completed_at":"2026-08-15T23:46:09.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 283.803596] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63912d396387c8b12ae1f124","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63912d396387c8b12ae1f124: start","job_status":"start","queue_duration_s":1.883542,"scheduling_latency_s":1.883559}1523gitlab # [ 283.816639] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63912d396387c8b12ae1f124","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63912d396387c8b12ae1f124: done: 0.01395 sec","job_status":"done","queue_duration_s":1.883542,"scheduling_latency_s":1.883559,"redis_calls":13,"redis_duration_s":0.001407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01395,"completed_at":"2026-08-15T23:46:09.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 283.856416] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90866f4fc6e6c74bd967f0fe","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90866f4fc6e6c74bd967f0fe: start","job_status":"start","queue_duration_s":1.898626,"scheduling_latency_s":1.898645}1525gitlab # [ 283.893802] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90866f4fc6e6c74bd967f0fe","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90866f4fc6e6c74bd967f0fe: done: 0.01402 sec","job_status":"done","queue_duration_s":1.898626,"scheduling_latency_s":1.898645,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01402,"completed_at":"2026-08-15T23:46:09.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 283.963405] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af62a9c8fd0ef863c844e82e","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af62a9c8fd0ef863c844e82e: start","job_status":"start","queue_duration_s":1.913691,"scheduling_latency_s":1.91371}1527gitlab # [ 283.979402] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af62a9c8fd0ef863c844e82e","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af62a9c8fd0ef863c844e82e: done: 0.014027 sec","job_status":"done","queue_duration_s":1.913691,"scheduling_latency_s":1.91371,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014027,"completed_at":"2026-08-15T23:46:09.057Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 284.026764] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b54eef64e4b3de5c10b5d8f1","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b54eef64e4b3de5c10b5d8f1: start","job_status":"start","queue_duration_s":1.92881,"scheduling_latency_s":1.928827}1529gitlab # [ 284.039799] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b54eef64e4b3de5c10b5d8f1","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b54eef64e4b3de5c10b5d8f1: done: 0.014189 sec","job_status":"done","queue_duration_s":1.92881,"scheduling_latency_s":1.928827,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014189,"completed_at":"2026-08-15T23:46:09.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 284.079172] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d853d2f2e50d86471dd25245","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d853d2f2e50d86471dd25245: start","job_status":"start","queue_duration_s":1.944078,"scheduling_latency_s":1.944096}1531gitlab # [ 284.091704] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d853d2f2e50d86471dd25245","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d853d2f2e50d86471dd25245: done: 0.013882 sec","job_status":"done","queue_duration_s":1.944078,"scheduling_latency_s":1.944096,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013882,"completed_at":"2026-08-15T23:46:09.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 284.130904] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89ec78c1cf8a19239e8e9893","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89ec78c1cf8a19239e8e9893: start","job_status":"start","queue_duration_s":1.959117,"scheduling_latency_s":1.959135}1533gitlab # [ 284.143308] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89ec78c1cf8a19239e8e9893","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89ec78c1cf8a19239e8e9893: done: 0.013997 sec","job_status":"done","queue_duration_s":1.959117,"scheduling_latency_s":1.959135,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013997,"completed_at":"2026-08-15T23:46:09.103Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 284.184339] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"510a33856e35c51510fb4e56","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-510a33856e35c51510fb4e56: start","job_status":"start","queue_duration_s":1.974218,"scheduling_latency_s":1.974236}1535gitlab # [ 284.196531] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"510a33856e35c51510fb4e56","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-510a33856e35c51510fb4e56: done: 0.013856 sec","job_status":"done","queue_duration_s":1.974218,"scheduling_latency_s":1.974236,"redis_calls":13,"redis_duration_s":0.0014030000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013856,"completed_at":"2026-08-15T23:46:09.117Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 284.235555] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aebda6942aaa3020c14cefa","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aebda6942aaa3020c14cefa: start","job_status":"start","queue_duration_s":1.989195,"scheduling_latency_s":1.989212}1537gitlab # [ 284.248086] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4aebda6942aaa3020c14cefa","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4aebda6942aaa3020c14cefa: done: 0.014177 sec","job_status":"done","queue_duration_s":1.989195,"scheduling_latency_s":1.989212,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014177,"completed_at":"2026-08-15T23:46:09.133Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 284.286185] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c35bc43b18af9f66e4d4811","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c35bc43b18af9f66e4d4811: start","job_status":"start","queue_duration_s":2.004531,"scheduling_latency_s":2.004549}1539gitlab # [ 284.298602] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c35bc43b18af9f66e4d4811","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c35bc43b18af9f66e4d4811: done: 0.013914 sec","job_status":"done","queue_duration_s":2.004531,"scheduling_latency_s":2.004549,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013914,"completed_at":"2026-08-15T23:46:09.148Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 284.337292] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d83d7761c5211bcaf0894879","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d83d7761c5211bcaf0894879: start","job_status":"start","queue_duration_s":2.019555,"scheduling_latency_s":2.019572}1541gitlab # [ 284.349647] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d83d7761c5211bcaf0894879","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d83d7761c5211bcaf0894879: done: 0.017384 sec","job_status":"done","queue_duration_s":2.019555,"scheduling_latency_s":2.019572,"redis_calls":13,"redis_duration_s":0.001533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017384,"completed_at":"2026-08-15T23:46:09.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 284.388932] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3c1a9b0443b413cf701f214","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3c1a9b0443b413cf701f214: start","job_status":"start","queue_duration_s":2.038107,"scheduling_latency_s":2.038125}1543gitlab # [ 284.401230] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3c1a9b0443b413cf701f214","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3c1a9b0443b413cf701f214: done: 0.013923 sec","job_status":"done","queue_duration_s":2.038107,"scheduling_latency_s":2.038125,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013923,"completed_at":"2026-08-15T23:46:09.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 284.439907] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"941581e1e39f625ebc700c7e","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-941581e1e39f625ebc700c7e: start","job_status":"start","queue_duration_s":2.053234,"scheduling_latency_s":2.053252}1545gitlab # [ 284.452874] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"941581e1e39f625ebc700c7e","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-941581e1e39f625ebc700c7e: done: 0.014392 sec","job_status":"done","queue_duration_s":2.053234,"scheduling_latency_s":2.053252,"redis_calls":13,"redis_duration_s":0.0014949999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014392,"completed_at":"2026-08-15T23:46:09.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 284.492158] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40e3d06952d5173fce17fcdd","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40e3d06952d5173fce17fcdd: start","job_status":"start","queue_duration_s":2.068747,"scheduling_latency_s":2.068765}1547gitlab # [ 284.504250] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40e3d06952d5173fce17fcdd","created_at":"2026-08-15T23:46:06.975Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-63f4c561cc9348f4","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7ec07f4c1e86193e7ad1aeef068fde16","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:07.129Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40e3d06952d5173fce17fcdd: done: 0.013928 sec","job_status":"done","queue_duration_s":2.068747,"scheduling_latency_s":2.068765,"redis_calls":13,"redis_duration_s":0.0014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013928,"completed_at":"2026-08-15T23:46:09.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 284.543189] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.213Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b923649935ee2487cfc7c2e1","created_at":"2026-08-15T23:46:08.297Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-07889859986b439b","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:08.309Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b923649935ee2487cfc7c2e1: start","job_status":"start","queue_duration_s":0.904204,"scheduling_latency_s":0.904222}1549gitlab # [ 284.555653] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.225Z","message":"No existing merge request to be cleaned up."}1550gitlab # [ 284.557439] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.234Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b923649935ee2487cfc7c2e1","created_at":"2026-08-15T23:46:08.297Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-07889859986b439b","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:08.309Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b923649935ee2487cfc7c2e1: done: 0.020672 sec","job_status":"done","queue_duration_s":0.904204,"scheduling_latency_s":0.904222,"redis_calls":10,"redis_duration_s":0.001364,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020672,"completed_at":"2026-08-15T23:46:09.234Z","load_balancing_strategy":"primary","db_duration_s":0.003432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 284.596706] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.235Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3d647b5f2befa8d576a8cdb8","created_at":"2026-08-15T23:46:08.297Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-07889859986b439b","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:08.309Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3d647b5f2befa8d576a8cdb8: start","job_status":"start","queue_duration_s":0.926061,"scheduling_latency_s":0.92608}1552gitlab # [ 284.609000] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.246Z","message":"No existing merge request to be cleaned up."}1553gitlab # [ 284.610681] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.254Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3d647b5f2befa8d576a8cdb8","created_at":"2026-08-15T23:46:08.297Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-07889859986b439b","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:08.309Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3d647b5f2befa8d576a8cdb8: done: 0.018986 sec","job_status":"done","queue_duration_s":0.926061,"scheduling_latency_s":0.92608,"redis_calls":10,"redis_duration_s":0.0013089999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000757,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018986,"completed_at":"2026-08-15T23:46:09.254Z","load_balancing_strategy":"primary","db_duration_s":0.0027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 284.649316] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.255Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"26418856a4db0195a6a61077","created_at":"2026-08-15T23:46:08.297Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-07889859986b439b","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:08.309Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-26418856a4db0195a6a61077: start","job_status":"start","queue_duration_s":0.946179,"scheduling_latency_s":0.946196}1555gitlab # [ 284.661815] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.266Z","message":"No existing merge request to be cleaned up."}1556gitlab # [ 284.663490] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.275Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"26418856a4db0195a6a61077","created_at":"2026-08-15T23:46:08.297Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-07889859986b439b","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:08.309Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-26418856a4db0195a6a61077: done: 0.019343 sec","job_status":"done","queue_duration_s":0.946179,"scheduling_latency_s":0.946196,"redis_calls":10,"redis_duration_s":0.0013210000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019343,"completed_at":"2026-08-15T23:46:09.274Z","load_balancing_strategy":"primary","db_duration_s":0.002629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 284.702213] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.276Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5fc84c720c47cad59c54d41d","created_at":"2026-08-15T23:46:08.297Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-07889859986b439b","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:08.309Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5fc84c720c47cad59c54d41d: start","job_status":"start","queue_duration_s":0.966666,"scheduling_latency_s":0.966683}1558gitlab # [ 284.714330] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.286Z","message":"No existing merge request to be cleaned up."}1559gitlab # [ 284.715955] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:09.294Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5fc84c720c47cad59c54d41d","created_at":"2026-08-15T23:46:08.297Z","trace_propagation_headers":{"sentry-trace":"8481fcb521794d92927384235efe9cc4-07889859986b439b","baggage":"sentry-trace_id=8481fcb521794d92927384235efe9cc4,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6d9e260278d33ff32e0d4c6e4dcb07e3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:08.309Z","job_size_bytes":2,"pid":2007,"sidekiq_tid":"mapr","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5fc84c720c47cad59c54d41d: done: 0.018611 sec","job_status":"done","queue_duration_s":0.966666,"scheduling_latency_s":0.966683,"redis_calls":10,"redis_duration_s":0.0012859999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018611,"completed_at":"2026-08-15T23:46:09.294Z","load_balancing_strategy":"primary","db_duration_s":0.002469,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 307.648268] postgres[3248]: [3248] ERROR: relation "table_without_models" does not exist1561gitlab # [ 307.653923] postgres[3248]: [3248] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1562gitlab # [ 309.177136] redis[789]: 10 changes in 300 seconds. Saving...1563gitlab # [ 309.177664] redis[789]: Background saving started by pid 32751564gitlab # [ 309.188280] redis[3275]: BGSAVE done, 473 keys saved, 0 keys skipped, 121255 bytes written.1565gitlab # [ 309.193672] redis[3275]: DB saved on disk1566gitlab # [ 309.195894] redis[3275]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1567gitlab # [ 309.278271] redis[789]: Background saving terminated with success1568gitlab # [ 310.238816] postgres[861]: [861] LOG: checkpoint starting: time1569gitlab # [ 312.222675] gitaly[910]: time="2026-08-15T23:46:39.108Z" level=info msg="burden monitor stats" pid=9101570gitlab # [ 313.212729] runuser[2915]: pam_unix(runuser:session): session closed for user gitlab1571gitlab # [ 313.217190] setup-gitlab-start[2893]: + systemctl restart gitlab-sidekiq.service1572gitlab # [ 313.249921] systemd[1]: Stopping gitlab-sidekiq.service...1573gitlab # [ 313.251409] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:40.137Z","message":"Shutting down"}1574gitlab # [ 313.253186] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:40.138Z","message":"Scheduler exiting..."}1575gitlab # [ 313.254861] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:40.139Z","message":"Terminating quiet threads for default capsule"}1576gitlab # [ 313.256911] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:40.139Z","message":"Scheduler exiting..."}1577gitlab # [ 313.753481] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:40.641Z","message":"Pausing to allow jobs to finish..."}1578gitlab # [ 317.758752] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:44.645Z","message":"Bye!"}1579gitlab # [ 317.800639] sidekiq-cluster[2007]: {"severity":"INFO","time":"2026-08-15T23:46:44.688Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2007,"worker_id":"sidekiq_0","memwd_rss_bytes":920993792,"retry":0}1580gitlab # [ 318.907112] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1581gitlab # [ 318.907564] systemd[1]: Stopped gitlab-sidekiq.service.1582gitlab # [ 318.907840] systemd[1]: gitlab-sidekiq.service: Consumed 1min 47.011s CPU time over 3min 17.493s wall clock time, 937.3M memory peak, 4.5M read from disk.1583gitlab # [ 318.921267] systemd[1]: Started gitlab-sidekiq.service.1584gitlab # [ 318.925556] setup-gitlab-start[2893]: + mkdir -p /var/lib/secrets1585gitlab # [ 318.930533] setup-gitlab-start[2893]: + echo nixbot-test-token-of-20-chars1586gitlab # [ 318.934001] setup-gitlab-start[2893]: + chmod 644 /var/lib/secrets/gitlab-token1587gitlab # [ 318.937202] setup-gitlab-start[2893]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1588gitlab # [ 321.436990] gitaly[910]: time="2026-08-15T23:46:48.323Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:58.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:48.323" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 321.437475] gitaly[910]: time="2026-08-15T23:46:48.324Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:58.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:48.323" grpc.time_ms=0.593 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 322.581303] gitaly[910]: time="2026-08-15T23:46:49.468Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:59.147" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.468" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 322.581504] gitaly[910]: time="2026-08-15T23:46:49.469Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:59.147" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.468" grpc.time_ms=0.638 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 322.679393] gitaly[910]: time="2026-08-15T23:46:49.567Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 diskcache=ebc0fcfd-1847-454f-8cb4-4a88df144c8f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:46:59.188" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.509" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 322.711391] gitaly[910]: time="2026-08-15T23:46:49.567Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=35 command.spawn_token_fork_ms=5 command.system_time_ms=13 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:46:59.188" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.509" grpc.time_ms=58.183 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 322.747132] gitaly[910]: time="2026-08-15T23:46:49.590Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:59.268" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.589" pid=910 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1595gitlab # [ 322.768486] gitaly[910]: time="2026-08-15T23:46:49.590Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:59.268" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.589" grpc.time_ms=1.171 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 322.786929] gitaly[910]: time="2026-08-15T23:46:49.620Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:46:59.283" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.603" grpc.time_ms=16.315 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 322.846466] gitaly[910]: time="2026-08-15T23:46:49.734Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:59.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.733" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1598gitlab # [ 322.875645] gitaly[910]: time="2026-08-15T23:46:49.734Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:59.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.733" grpc.time_ms=0.58 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1599gitlab # [ 322.902658] gitaly[910]: time="2026-08-15T23:46:49.782Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 diskcache=0f17da5a-a1ec-4155-ae56-686321ac317c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:46:59.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.737" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1600gitlab # [ 322.923388] gitaly[910]: time="2026-08-15T23:46:49.782Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=26 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T23:46:59.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.737" grpc.time_ms=44.869 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1601gitlab # [ 322.945491] gitaly[910]: time="2026-08-15T23:46:49.791Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:59.060" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.790" pid=910 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1602gitlab # [ 322.959123] gitaly[910]: time="2026-08-15T23:46:49.792Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:59.060" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.790" grpc.time_ms=0.97 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1603gitlab # [ 322.973950] gitaly[910]: time="2026-08-15T23:46:49.814Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:46:59.071" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.801" grpc.time_ms=12.74 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1604gitlab # [ 322.991681] gitaly[910]: time="2026-08-15T23:46:49.875Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:46:59.144" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.875" grpc.time_ms=0.285 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1605gitlab # [ 323.005640] gitaly[910]: time="2026-08-15T23:46:49.893Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:46:59.161" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:49.892" grpc.time_ms=0.502 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 323.656564] gitaly[910]: time="2026-08-15T23:46:50.543Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X47EVH3VGNC3T1PGTSMS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:47:00.205" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:50.526" grpc.time_ms=16.776 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 323.997390] sidekiq-cluster[3317]: {"severity":"INFO","time":"2026-08-15T23:46:50.845Z","message":"Starting cluster with 1 processes"}1608gitlab # [ 324.040593] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:50 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 50751609gitlab # [ 324.046885] setup-gitlab-start[2893]: + mkdir -p /tmp/test-flake1610gitlab # [ 324.049865] setup-gitlab-start[2893]: + cd /tmp/test-flake1611gitlab # [ 324.052404] setup-gitlab-start[2893]: + git init -b master1612gitlab # [ 324.068717] setup-gitlab-start[3380]: Initialized empty Git repository in /tmp/test-flake/.git/1613gitlab # [ 324.072367] setup-gitlab-start[2893]: + git config user.name test1614gitlab # [ 324.074920] setup-gitlab-start[2893]: + git config user.email test@example.com1615gitlab # [ 324.078152] setup-gitlab-start[2893]: + cat1616gitlab # [ 324.080112] setup-gitlab-start[2893]: + git add flake.nix1617gitlab # [ 324.083810] setup-gitlab-start[2893]: + git commit -m 'initial commit'1618gitlab # [ 324.106215] setup-gitlab-start[3385]: [master (root-commit) dd3a78d] initial commit1619gitlab # [ 324.107667] setup-gitlab-start[3385]: 1 file changed, 10 insertions(+)1620gitlab # [ 324.108967] setup-gitlab-start[3385]: create mode 100644 flake.nix1621gitlab # [ 324.110141] setup-gitlab-start[2893]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1622gitlab # [ 324.120772] setup-gitlab-start[2893]: + git push -u origin master1623gitlab # [ 324.218281] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 591624gitlab # [ 324.407391] gitaly[910]: time="2026-08-15T23:46:51.294Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CK3T57NHS76XMT1B6NG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:51.277" grpc.time_ms=16.773 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 324.447751] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1881626gitlab # [ 325.240253] gitaly[910]: time="2026-08-15T23:46:52.126Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:47:02.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:52.112" grpc.time_ms=14.049 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 325.298577] gitaly[910]: time="2026-08-15T23:46:52.186Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-15T23:47:22.073" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-15T23:46:52.173" grpc.time_ms=12.56 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1628gitlab # [ 325.381818] gitaly[910]: time="2026-08-15T23:46:52.268Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM duration_ms=283ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/allowed"1629gitlab # [ 325.559662] gitaly[910]: time="2026-08-15T23:46:52.447Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM duration_ms=178ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/pre_receive"1630gitlab # [ 325.563206] gitaly[910]: time="2026-08-15T23:46:52.448Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:51.982" grpc.time_ms=465.699 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1631gitlab # [ 325.612151] gitaly[910]: time="2026-08-15T23:46:52.499Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:52.498" grpc.time_ms=1.402 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1632gitlab # [ 325.681836] gitaly[910]: time="2026-08-15T23:46:52.569Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:52.564" grpc.time_ms=5.384 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1633gitlab # [ 325.743249] gitaly[910]: time="2026-08-15T23:46:52.631Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:52.630" grpc.time_ms=0.873 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1634gitlab # [ 325.934570] gitaly[910]: time="2026-08-15T23:46:52.822Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:47:02.074" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:52.804" grpc.time_ms=17.017 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1635gitlab # [ 325.977867] gitaly[910]: time="2026-08-15T23:46:52.865Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-15T23:47:02.102" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:46:52.833" grpc.time_ms=31.782 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1636gitlab # [ 326.003123] gitaly[910]: time="2026-08-15T23:46:52.890Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM duration_ms=192ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/post_receive"1637gitlab # [ 326.007782] gitaly[910]: time="2026-08-15T23:46:52.891Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:52.697" grpc.time_ms=194.168 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1638gitlab # [ 326.024145] gitaly[910]: time="2026-08-15T23:46:52.907Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM diskcache=554980b0-cab4-4676-b2ca-6cd08af76669 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:51.873" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1639gitlab # [ 326.039545] gitlab-workhorse[820]: time="2026-08-15T23:46:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521640gitlab # [ 326.042367] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:52 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 15941641gitlab # [ 326.045169] setup-gitlab-start[3389]: To http://gitlab/root/test-flake.git1642gitlab # [ 326.046441] setup-gitlab-start[3389]: * [new branch] master -> master1643gitlab # [ 326.047695] setup-gitlab-start[3389]: branch 'master' set up to track 'origin/master'.1644gitlab # [ 326.049213] gitaly[910]: time="2026-08-15T23:46:52.907Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=336 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13192 command.oublock=32 command.real_time_ms=1026 command.spawn_token_fork_ms=1 command.system_time_ms=155 command.user_time_ms=181 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:51.873" grpc.time_ms=1034.334 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1645gitlab # [ 326.065756] systemd[1]: Finished setup-gitlab.service.1646gitlab # [ 326.066662] systemd[1]: Starting nixbot CI service...1647gitlab: (finished: waiting for unit setup-gitlab.service, in 327.37 seconds)1648gitlab: waiting for unit nixbot.service1649gitlab # [ 327.434680] nixbot[3472]: {"ts": "2026-08-15T23:46:54.321Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1650gitlab # [ 327.481163] nixbot[3472]: {"ts": "2026-08-15T23:46:54.368Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1651gitlab # [ 327.513747] nixbot[3472]: {"ts": "2026-08-15T23:46:54.401Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1652gitlab # [ 327.520587] nixbot[3472]: {"ts": "2026-08-15T23:46:54.407Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1653gitlab # [ 327.527240] nixbot[3472]: {"ts": "2026-08-15T23:46:54.414Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1654gitlab # [ 327.535578] nixbot[3472]: {"ts": "2026-08-15T23:46:54.423Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1655gitlab # [ 327.542229] nixbot[3472]: {"ts": "2026-08-15T23:46:54.429Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1656gitlab # [ 327.548880] nixbot[3472]: {"ts": "2026-08-15T23:46:54.432Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1657gitlab # [ 327.555266] nixbot[3472]: {"ts": "2026-08-15T23:46:54.441Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1658gitlab # [ 327.561828] nixbot[3472]: {"ts": "2026-08-15T23:46:54.444Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1659gitlab # [ 327.568543] nixbot[3472]: {"ts": "2026-08-15T23:46:54.451Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1660gitlab # [ 327.574971] nixbot[3472]: {"ts": "2026-08-15T23:46:54.460Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1661gitlab # [ 327.581757] nixbot[3472]: {"ts": "2026-08-15T23:46:54.465Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1662gitlab # [ 327.588563] nixbot[3472]: {"ts": "2026-08-15T23:46:54.468Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1663gitlab # [ 327.595041] nixbot[3472]: {"ts": "2026-08-15T23:46:54.473Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1664gitlab # [ 327.601390] nixbot[3472]: {"ts": "2026-08-15T23:46:54.476Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1665gitlab # [ 327.607152] nixbot[3472]: {"ts": "2026-08-15T23:46:54.478Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1666gitlab # [ 327.612875] nixbot[3472]: {"ts": "2026-08-15T23:46:54.480Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1667gitlab # [ 327.618223] nixbot[3472]: {"ts": "2026-08-15T23:46:54.486Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1668gitlab # [ 327.623635] nixbot[3472]: {"ts": "2026-08-15T23:46:54.489Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1669gitlab # [ 327.629020] nixbot[3472]: {"ts": "2026-08-15T23:46:54.491Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1670gitlab # [ 327.633587] nixbot[3472]: {"ts": "2026-08-15T23:46:54.498Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1671gitlab # [ 327.638041] nixbot[3472]: {"ts": "2026-08-15T23:46:54.500Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1672gitlab # [ 327.642820] nixbot[3472]: {"ts": "2026-08-15T23:46:54.503Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1673gitlab # [ 327.655722] nixbot[3472]: {"ts": "2026-08-15T23:46:54.505Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1674gitlab # [ 327.999925] nixbot[3472]: INFO: Started server process [3472]1675gitlab # [ 328.000976] nixbot[3472]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1676gitlab # [ 328.046803] nixbot[3472]: INFO: ::ffff:127.0.0.1:43180 - "GET /health HTTP/1.1" 200 OK1677gitlab # [ 328.055746] systemd[1]: Started nixbot CI service.1678gitlab # [ 328.062485] systemd[1]: Reached target Multi-User System.1679gitlab # [ 328.065001] systemd[1]: Startup finished in 763ms (kernel) + 4.487s (initrd) + 5min 22.810s (userspace) = 5min 28.061s.1680gitlab: (finished: waiting for unit nixbot.service, in 2.13 seconds)1681gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1682gitlab # [ 329.113313] nixbot[3472]: INFO: ::ffff:127.0.0.1:43182 - "GET /health HTTP/1.1" 200 OK1683gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1684subtest: project discovered and webhook registered1685gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1686gitlab # [ 329.179913] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:56 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 11331687gitlab # [ 329.182486] nixbot[3472]: {"ts": "2026-08-15T23:46:56.070Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1688gitlab # [ 329.209097] nixbot[3472]: {"ts": "2026-08-15T23:46:56.096Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1689gitlab # [ 329.274117] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1101690gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1691gitlab # [ 329.294347] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 761692gitlab # [ 329.304521] nixbot[3472]: {"ts": "2026-08-15T23:46:56.183Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1693gitlab # [ 329.312924] nixbot[3472]: {"ts": "2026-08-15T23:46:56.184Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1694gitlab # [ 329.455558] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1541695gitlab # [ 329.457837] nixbot[3472]: {"ts": "2026-08-15T23:46:56.345Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1696gitlab # [ 329.792160] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:56 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3151697gitlab # [ 329.800670] nixbot[3472]: {"ts": "2026-08-15T23:46:56.676Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1698gitlab # [ 329.986766] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1721699gitlab # [ 329.993356] nixbot[3472]: {"ts": "2026-08-15T23:46:56.875Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1700gitlab # [ 330.071855] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:56 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 791701gitlab # [ 330.078772] nixbot[3472]: {"ts": "2026-08-15T23:46:56.960Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1702gitlab # [ 330.171401] gitaly[910]: time="2026-08-15T23:46:57.057Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4JA62X0H3F9M90FGVAYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-15T23:47:27.031" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:46:57.032" grpc.time_ms=24.833 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703gitlab # [ 330.215079] gitaly[910]: time="2026-08-15T23:46:57.074Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4JA62X0H3F9M90FGVAYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:47:27.072" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:46:57.073" grpc.time_ms=1.07 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 330.238554] gitaly[910]: time="2026-08-15T23:46:57.116Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4JA62X0H3F9M90FGVAYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-15T23:47:07.009" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:46:57.100" grpc.time_ms=16.212 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705gitlab # [ 330.276650] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1971706gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1707gitlab # [ 330.282734] nixbot[3472]: {"ts": "2026-08-15T23:46:57.164Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1708gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.13 seconds)1709gitlab # [ 330.404733] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 651710(finished: subtest: project discovered and webhook registered, in 1.29 seconds)1711subtest: push delivers the webhook1712gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1713gitlab # [ 330.419569] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1381714gitlab # [ 330.426335] nixbot[3472]: {"ts": "2026-08-15T23:46:57.308Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1715gitlab # [ 330.433330] nixbot[3472]: {"ts": "2026-08-15T23:46:57.313Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1716gitlab # [ 330.524579] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:57 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 411717gitlab # [ 330.576088] gitaly[910]: time="2026-08-15T23:46:57.463Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X4JPV94KBECEAVMPYWWYX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.447" grpc.time_ms=16.402 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1718gitlab # [ 330.594076] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 921719gitlab # [ 330.674890] gitaly[910]: time="2026-08-15T23:46:57.562Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M03X4JR6ZW3JXSRJ58VKA12Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.551" grpc.time_ms=10.771 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1720gitlab # Enumerating objects: 5, done.1721gitlab # [ 330.703392] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:57 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1491722gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1723gitlab # Delta compression using up to 4 threads1724gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1725gitlab # Writing objects: 33% (1/3)[ 330.716994] gitaly[910]: time="2026-08-15T23:46:57.604Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4JST2R05Y9B5678AG7TR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.570" pid=910 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1726gitlab # [ 330.736843] gitaly[910]: time="2026-08-15T23:46:57.604Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=21 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4JST2R05Y9B5678AG7TR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.570" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1727gitlab # Writing objects: 66% (2/3)[ 330.759001] gitlab-workhorse[820]: time="2026-08-15T23:46:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131728gitlab # Writing objects: 100% (3/3)[ 330.762082] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1401729gitlab # Writing objects: 100% (3/3), 274 bytes | 5.00 KiB/s, done.1730gitlab # [ 330.765036] gitaly[910]: time="2026-08-15T23:46:57.605Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=21 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4JST2R05Y9B5678AG7TR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.570" grpc.time_ms=34.834 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1731gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1732gitlab # [ 330.996283] gitaly[910]: time="2026-08-15T23:46:57.883Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4JYESSDNAV5PVNC0HZM0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.843" pid=910 remote_ip="2001:db8:1::1" request_sha=40b4bfd68bb196c2609fae01dfcd6e5ebe2d9251 response_bytes=223 span.kind=server system=grpc1733gitlab # [ 331.022784] gitaly[910]: time="2026-08-15T23:46:57.884Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1139 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=6 command.system_time_ms=24 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4JYESSDNAV5PVNC0HZM0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.843" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1734gitlab # [ 331.054306] gitlab-workhorse[820]: time="2026-08-15T23:46:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231735gitlab # [ 331.061380] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 2701736gitlab # [ 331.067041] gitaly[910]: time="2026-08-15T23:46:57.885Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1139 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=6 command.system_time_ms=24 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4JYESSDNAV5PVNC0HZM0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.843" grpc.time_ms=41.266 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1737gitlab # [ 331.204825] gitaly[910]: time="2026-08-15T23:46:58.092Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X4KA9DVAN4J2418DCMG4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:58.074" grpc.time_ms=17.082 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1738gitlab # [ 331.224018] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 991739gitlab # [ 331.275120] gitaly[910]: time="2026-08-15T23:46:58.162Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-15T23:47:28.151" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-15T23:46:58.151" grpc.time_ms=10.899 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1740gitlab # [ 331.314148] gitaly[910]: time="2026-08-15T23:46:58.202Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A duration_ms=189ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/allowed"1741gitlab # [ 331.349326] gitaly[910]: time="2026-08-15T23:46:58.237Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A duration_ms=34ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/pre_receive"1742gitlab # [ 331.360262] gitaly[910]: time="2026-08-15T23:46:58.237Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:58.011" grpc.time_ms=225.525 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1743gitlab # [ 331.427501] gitaly[910]: time="2026-08-15T23:46:58.315Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:58.314" grpc.time_ms=0.874 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1744gitlab # [ 331.506864] gitaly[910]: time="2026-08-15T23:46:58.394Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:58.393" grpc.time_ms=0.813 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1745gitlab # [ 331.523631] gitaly[910]: time="2026-08-15T23:46:58.404Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4KDE7F24TQE5ZP60E4X5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:58.382" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1746gitlab # [ 331.540335] gitlab-workhorse[820]: time="2026-08-15T23:46:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671747gitlab # [ 331.543228] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 3101748gitlab # [ 331.546232] gitaly[910]: time="2026-08-15T23:46:58.404Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4KDE7F24TQE5ZP60E4X5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:58.382" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1749gitlab # [ 331.565365] gitaly[910]: time="2026-08-15T23:46:58.404Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4KDE7F24TQE5ZP60E4X5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:58.382" grpc.time_ms=22.15 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1750gitlab # [ 331.584377] gitaly[910]: time="2026-08-15T23:46:58.434Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:58.433" grpc.time_ms=0.79 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1751gitlab # [ 331.667068] gitaly[910]: time="2026-08-15T23:46:58.553Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A duration_ms=89ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/post_receive"1752gitlab # [ 331.672145] gitaly[910]: time="2026-08-15T23:46:58.554Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:58.463" grpc.time_ms=90.951 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1753gitlab # To http://gitlab/root/test-flake.git1754gitlab # [ 331.685494] gitaly[910]: time="2026-08-15T23:46:58.567Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A diskcache=99cb51cc-958a-40bc-a23c-910f77f563ea grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.901" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1755gitlab # dd3a78d..0609b2d [ 331.698278] gitlab-workhorse[820]: time="2026-08-15T23:46:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521756gitlab # master -> master[ 331.700698] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:58 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8931757gitlab # 1758gitlab # [ 331.703145] gitaly[910]: time="2026-08-15T23:46:58.568Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=212 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=12938 command.oublock=32 command.real_time_ms=658 command.spawn_token_fork_ms=0 command.system_time_ms=149 command.user_time_ms=63 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:57.901" grpc.time_ms=666.575 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1759gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.32 seconds)1760gitlab: must succeed: git -C /tmp/test-flake rev-parse master1761gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1762gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1763gitlab # [ 331.720575] gitaly[910]: time="2026-08-15T23:46:58.593Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=12 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M03X4KSK5WBCGQWK7YZ1XTZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:58.576" grpc.time_ms=17.123 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1764gitlab # [ 331.754534] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1101765gitlab # [ 331.800304] gitaly[910]: time="2026-08-15T23:46:58.687Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4KXG8YVTJX4S0F1Q4QFP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:58.665" pid=910 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1766gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.09 seconds)1767gitlab # [ 331.828494] gitaly[910]: time="2026-08-15T23:46:58.692Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4KXG8YVTJX4S0F1Q4QFP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:58.665" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1768gitlab # [ 331.858234] gitlab-workhorse[820]: time="2026-08-15T23:46:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091769gitlab # [ 331.861748] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 841770gitlab # [ 331.865677] nixbot[3472]: INFO: ::ffff:127.0.0.1:39162 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1771gitlab # [ 331.868904] gitaly[910]: time="2026-08-15T23:46:58.692Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4KXG8YVTJX4S0F1Q4QFP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:46:58.665" grpc.time_ms=27.257 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1772gitlab # [ 331.920795] gitaly[910]: time="2026-08-15T23:46:58.808Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:47:28.706" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:46:58.806" grpc.time_ms=1.433 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 331.965523] gitaly[910]: time="2026-08-15T23:46:58.853Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-15T23:47:28.742" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:46:58.842" grpc.time_ms=10.328 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 331.992440] gitaly[910]: time="2026-08-15T23:46:58.879Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:47:08.138" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:46:58.869" grpc.time_ms=10.005 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 332.011651] gitaly[910]: time="2026-08-15T23:46:58.898Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:47:08.158" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:46:58.889" grpc.time_ms=8.984 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 332.103735] gitaly[910]: time="2026-08-15T23:46:58.991Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:47:08.259" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:58.990" grpc.time_ms=0.651 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 332.137119] gitaly[910]: time="2026-08-15T23:46:59.008Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:47:08.268" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:46:58.999" grpc.time_ms=8.351 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778gitlab # [ 332.182057] gitaly[910]: time="2026-08-15T23:46:59.069Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:59.068" grpc.time_ms=0.932 pid=910 span.kind=server system=grpc1779gitlab # [ 332.227158] gitaly[910]: time="2026-08-15T23:46:59.113Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:46:59.112" grpc.time_ms=1.085 pid=910 span.kind=server system=grpc1780gitlab # [ 332.254561] gitaly[910]: time="2026-08-15T23:46:59.124Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V diskcache=8dfba92b-f701-4a0d-9134-a89d0a2de09a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:47:09.009" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:59.010" pid=910 ref=refs/keep-around/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 remote_ip="2001:db8:1::1" revision=dd3a78d90f61d83b3a1662fecd5cecd3299a1794 span.kind=server system=grpc username=root1781gitlab # [ 332.277930] gitaly[910]: time="2026-08-15T23:46:59.125Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=105 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5278 command.oublock=8 command.real_time_ms=107 command.spawn_token_fork_ms=3 command.system_time_ms=64 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:47:09.009" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:46:59.010" grpc.time_ms=114.264 pid=910 ref=refs/keep-around/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 remote_ip="2001:db8:1::1" revision=dd3a78d90f61d83b3a1662fecd5cecd3299a1794 span.kind=server system=grpc username=root1782gitlab # [ 332.299791] gitaly[910]: time="2026-08-15T23:46:59.130Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:47:29.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:46:59.129" grpc.time_ms=0.505 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 332.481493] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:46:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 6381784gitlab # [ 332.489891] nixbot[3472]: {"ts": "2026-08-15T23:46:59.370Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 \"HTTP/1.1 201 Created\""}1785gitlab # [ 332.498649] nixbot[3472]: {"ts": "2026-08-15T23:46:59.376Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-dd3a78d90f61-0"}1786gitlab # [ 332.610430] systemd[1]: Started Nix Daemon.1787gitlab # [ 332.712243] nix-daemon[3694]: accepted connection from pid 3688, user nixbot1788gitlab # [ 332.821670] nix-daemon[3694]: accepted connection from pid 3701, user nixbot1789gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1790gitlab # [ 332.845003] nixbot[3472]: {"ts": "2026-08-15T23:46:59.732Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-dd3a78d90f61-0", "argv0": "bwrap"}1791gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.08 seconds)1792gitlab # [ 332.909619] nixbot[3472]: INFO: ::ffff:127.0.0.1:39172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1793gitlab # [ 333.067053] nix-daemon[3694]: accepted connection from pid 3714, user nixbot1794gitlab # [ 333.148457] nix-daemon[3694]: accepted connection from pid 3724, user nixbot1795gitlab # [ 333.170951] nix-daemon[3694]: accepted connection from pid 3714, user nixbot1796gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1797gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1798gitlab # [ 333.960237] nixbot[3472]: INFO: ::ffff:127.0.0.1:39174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1799gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1800gitlab # [ 335.013156] nixbot[3472]: INFO: ::ffff:127.0.0.1:39182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1801gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1802gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1803gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1804gitlab # [ 336.067926] nixbot[3472]: INFO: ::ffff:127.0.0.1:39196 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1805gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1806gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1807gitlab # [ 337.121022] nixbot[3472]: INFO: ::ffff:127.0.0.1:39212 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1808gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1809gitlab # [ 338.185132] nixbot[3472]: INFO: ::ffff:127.0.0.1:39218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1810gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.07 seconds)1811gitlab # [ 338.272087] gitaly[910]: time="2026-08-15T23:47:05.159Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4T6ZPH3HNKHCP4Y55J8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:47:35.056" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:47:05.157" grpc.time_ms=1.226 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812gitlab # [ 338.479218] gitaly[910]: time="2026-08-15T23:47:05.366Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X4T6ZPH3HNKHCP4Y55J8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:47:15.028" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:47:05.348" grpc.time_ms=17.687 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 338.629994] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:47:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 4601814gitlab # [ 338.639599] nixbot[3472]: {"ts": "2026-08-15T23:47:05.518Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 \"HTTP/1.1 201 Created\""}1815gitlab # [ 338.769263] gitaly[910]: time="2026-08-15T23:47:05.656Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4TNPHV71NSFS9MTWBKKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:47:35.654" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:47:05.655" grpc.time_ms=1.219 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 338.958042] gitaly[910]: time="2026-08-15T23:47:05.845Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4TNPHV71NSFS9MTWBKKX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:47:15.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:47:05.827" grpc.time_ms=17.811 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 339.093058] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:47:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4541818gitlab # [ 339.101128] nixbot[3472]: {"ts": "2026-08-15T23:47:05.981Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 \"HTTP/1.1 201 Created\""}1819gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1820gitlab # [ 339.217976] gitaly[910]: time="2026-08-15T23:47:06.105Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4V4AX3J0J4EW6889ZHAV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:47:36.103" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:47:06.104" grpc.time_ms=1.1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1822gitlab # [ 339.257061] nixbot[3472]: INFO: ::ffff:127.0.0.1:39234 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1823gitlab # [ 339.298342] gitaly[910]: time="2026-08-15T23:47:06.185Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4V4AX3J0J4EW6889ZHAV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:47:16.076" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:47:06.167" grpc.time_ms=17.448 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 339.404092] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:47:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2961825gitlab # [ 339.412499] nixbot[3472]: {"ts": "2026-08-15T23:47:06.293Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 \"HTTP/1.1 201 Created\""}1826gitlab # [ 339.564438] nix-daemon[3694]: accepted connection from pid 3770, user nixbot1827gitlab # [ 339.771988] gitaly[910]: time="2026-08-15T23:47:06.658Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X4VN8DYAEKJ0X7M9KRKBB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:47:06.641" grpc.time_ms=17.039 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1828gitlab # [ 339.801199] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:47:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1231829gitlab # [ 339.907980] gitaly[910]: time="2026-08-15T23:47:06.795Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4VS6F3X5KQ656GAZETDS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:47:06.776" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1830gitlab # [ 339.938217] gitaly[910]: time="2026-08-15T23:47:06.795Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4VS6F3X5KQ656GAZETDS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:47:06.776" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1831gitlab # [ 339.969109] gitlab-workhorse[820]: time="2026-08-15T23:47:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671832gitlab # [ 339.972968] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:47:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1341833gitlab # [ 339.976884] gitaly[910]: time="2026-08-15T23:47:06.796Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4VS6F3X5KQ656GAZETDS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:47:06.776" grpc.time_ms=19.976 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1834gitlab # [ 340.088393] gitaly[910]: time="2026-08-15T23:47:06.976Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4VXHPYZ60JEQDC2EEP1S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:47:06.940" pid=910 remote_ip="2001:db8:1::1" request_sha=4e47aa18a32323bd21f1398daa5de48a247e379b response_bytes=338 span.kind=server system=grpc1835gitlab # [ 340.120353] gitaly[910]: time="2026-08-15T23:47:06.976Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4VXHPYZ60JEQDC2EEP1S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:47:06.940" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1836gitlab # [ 340.148991] gitlab-workhorse[820]: time="2026-08-15T23:47:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3381837gitlab # [ 340.152092] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:47:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 1761838gitlab # [ 340.156333] gitaly[910]: time="2026-08-15T23:47:06.977Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4VXHPYZ60JEQDC2EEP1S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:47:06.940" grpc.time_ms=35.915 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1839gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1840gitlab # [ 340.271375] nix-daemon[3694]: accepted connection from pid 3800, user nixbot1841gitlab # [ 340.315061] nixbot[3472]: INFO: ::ffff:127.0.0.1:39250 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1842gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.07 seconds)1843gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1844gitlab # [ 341.371517] nixbot[3472]: INFO: ::ffff:127.0.0.1:59568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1845gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1846gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1847gitlab # [ 342.426757] nixbot[3472]: INFO: ::ffff:127.0.0.1:59580 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1848gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1849gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1850gitlab # [ 343.482993] nixbot[3472]: INFO: ::ffff:127.0.0.1:59594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1852gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1853gitlab # [ 344.537522] nixbot[3472]: INFO: ::ffff:127.0.0.1:59606 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1854gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1855gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1856gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1857gitlab # [ 345.593171] nixbot[3472]: INFO: ::ffff:127.0.0.1:59614 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1858gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1859gitlab # [ 346.646311] nixbot[3472]: INFO: ::ffff:127.0.0.1:59618 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1860gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1861gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1862gitlab # [ 347.700669] nixbot[3472]: INFO: ::ffff:127.0.0.1:59624 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1863gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1864gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1865gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1866gitlab # [ 348.755175] nixbot[3472]: INFO: ::ffff:127.0.0.1:59636 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1867gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1868gitlab # [ 349.806922] nixbot[3472]: INFO: ::ffff:127.0.0.1:59652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1869gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1870gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1871gitlab # [ 350.862074] nixbot[3472]: INFO: ::ffff:127.0.0.1:36446 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1872gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1873gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1874gitlab # [ 351.916256] nixbot[3472]: INFO: ::ffff:127.0.0.1:36462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1875gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1876gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1877gitlab # [ 352.971441] nixbot[3472]: INFO: ::ffff:127.0.0.1:36470 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1879gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1880gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1881gitlab # [ 354.026460] nixbot[3472]: INFO: ::ffff:127.0.0.1:36484 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1882gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1883gitlab # [ 355.079663] nixbot[3472]: INFO: ::ffff:127.0.0.1:36486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1884gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1885gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1886gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1887gitlab # [ 356.134829] nixbot[3472]: INFO: ::ffff:127.0.0.1:36498 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1888gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1889gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1890gitlab # [ 357.186845] nixbot[3472]: INFO: ::ffff:127.0.0.1:36502 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1891gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1893gitlab # [ 358.239636] nixbot[3472]: INFO: ::ffff:127.0.0.1:36506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1894gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1895gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1896gitlab # [ 359.291911] nixbot[3472]: INFO: ::ffff:127.0.0.1:36512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1897gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1898gitlab # [ 360.344770] nixbot[3472]: INFO: ::ffff:127.0.0.1:36524 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1900gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1901gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1902gitlab # [ 361.400231] nixbot[3472]: INFO: ::ffff:127.0.0.1:52136 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1904gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.03 seconds)1905gitlab # [ 362.430524] nixbot[3472]: INFO: ::ffff:127.0.0.1:52140 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1906gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1907gitlab # [ 363.481643] nixbot[3472]: INFO: ::ffff:127.0.0.1:52152 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1908gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1910gitlab # [ 364.508238] sidekiq-cluster[3375]: 2026-08-15T23:47:31.394Z pid=3375 tid=yo7 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3375, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431263744}1911gitlab # [ 364.537261] nixbot[3472]: INFO: ::ffff:127.0.0.1:52162 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1912gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1913gitlab # [ 364.789958] sidekiq-cluster[3375]: W, [2026-08-15T23:47:31.677625 #3375] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1914gitlab # [ 364.853758] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:47:31.741Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1915gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1916gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1917gitlab # [ 365.591889] nixbot[3472]: INFO: ::ffff:127.0.0.1:52176 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1918gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1919gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1920gitlab # [ 366.645006] nixbot[3472]: INFO: ::ffff:127.0.0.1:52184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1922gitlab # [ 367.697997] nixbot[3472]: INFO: ::ffff:127.0.0.1:52196 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1924gitlab # [ 368.321347] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:47:35.208Z","message":"GitLab reliable fetch activated!"}1925gitlab # [ 368.321819] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:47:35.208Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1926gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1927gitlab # [ 368.754479] nixbot[3472]: INFO: ::ffff:127.0.0.1:52198 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1928gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1929gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1931gitlab # [ 369.809048] nixbot[3472]: INFO: ::ffff:127.0.0.1:52210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1933gitlab # [ 370.861763] nixbot[3472]: INFO: ::ffff:127.0.0.1:47294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1934gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1936gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1937gitlab # [ 371.916643] nixbot[3472]: INFO: ::ffff:127.0.0.1:47298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1939gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1940gitlab # [ 372.969299] nixbot[3472]: INFO: ::ffff:127.0.0.1:47302 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1941gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1942gitlab # [ 374.021988] nixbot[3472]: INFO: ::ffff:127.0.0.1:47318 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1944gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1945gitlab # [ 375.077719] nixbot[3472]: INFO: ::ffff:127.0.0.1:47330 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1947gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1948gitlab # [ 376.132680] nixbot[3472]: INFO: ::ffff:127.0.0.1:47338 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1949gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1950gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1951gitlab # [ 377.188213] nixbot[3472]: INFO: ::ffff:127.0.0.1:47340 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1955gitlab # [ 378.244256] nixbot[3472]: INFO: ::ffff:127.0.0.1:47356 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1957gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1958gitlab # [ 379.296979] nixbot[3472]: INFO: ::ffff:127.0.0.1:47360 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1960gitlab # [ 380.351474] nixbot[3472]: INFO: ::ffff:127.0.0.1:47372 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1963gitlab # [ 381.407888] nixbot[3472]: INFO: ::ffff:127.0.0.1:42744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1965gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1966gitlab # [ 382.463077] nixbot[3472]: INFO: ::ffff:127.0.0.1:42760 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1969gitlab # [ 383.517824] nixbot[3472]: INFO: ::ffff:127.0.0.1:42764 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1970gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1972gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1973gitlab # [ 384.572212] nixbot[3472]: INFO: ::ffff:127.0.0.1:42768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1975gitlab # [ 385.624727] nixbot[3472]: INFO: ::ffff:127.0.0.1:42782 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1976gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1978gitlab # [ 386.680372] nixbot[3472]: INFO: ::ffff:127.0.0.1:42784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1981gitlab # [ 387.737056] nixbot[3472]: INFO: ::ffff:127.0.0.1:42792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1984gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1985gitlab # [ 388.792462] nixbot[3472]: INFO: ::ffff:127.0.0.1:42800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1987gitlab # [ 389.845552] nixbot[3472]: INFO: ::ffff:127.0.0.1:42804 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1990gitlab # [ 390.900581] nixbot[3472]: INFO: ::ffff:127.0.0.1:40996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1993gitlab # [ 391.955049] nixbot[3472]: INFO: ::ffff:127.0.0.1:41012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1995gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)1997gitlab # [ 393.010150] nixbot[3472]: INFO: ::ffff:127.0.0.1:41014 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK1998gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'1999gitlab # [ 394.062816] nixbot[3472]: INFO: ::ffff:127.0.0.1:41024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2000gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)2001gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2003gitlab # [ 395.118856] nixbot[3472]: INFO: ::ffff:127.0.0.1:41032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2004gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2005gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2006gitlab # [ 396.172773] nixbot[3472]: INFO: ::ffff:127.0.0.1:41038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2007gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2008gitlab # [ 397.226184] nixbot[3472]: INFO: ::ffff:127.0.0.1:41042 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2009gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2011gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2012gitlab # [ 398.282233] nixbot[3472]: INFO: ::ffff:127.0.0.1:41052 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2015gitlab # [ 399.335284] nixbot[3472]: INFO: ::ffff:127.0.0.1:41068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2018gitlab # [ 400.387858] nixbot[3472]: INFO: ::ffff:127.0.0.1:41082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2020gitlab # [ 401.441658] nixbot[3472]: INFO: ::ffff:127.0.0.1:41968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2024gitlab # [ 402.497549] nixbot[3472]: INFO: ::ffff:127.0.0.1:41982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2026gitlab # [ 403.548835] nixbot[3472]: INFO: ::ffff:127.0.0.1:41988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2027gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)2028gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2029gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2030gitlab # [ 404.607617] nixbot[3472]: INFO: ::ffff:127.0.0.1:41994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2031gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2032gitlab # [ 405.659981] nixbot[3472]: INFO: ::ffff:127.0.0.1:42004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2033gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2034gitlab # [ 405.964271] postgres[4009]: [4009] ERROR: relation "table_without_models" does not exist2035gitlab # [ 405.967725] postgres[4009]: [4009] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2038gitlab # [ 406.715736] nixbot[3472]: INFO: ::ffff:127.0.0.1:42010 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2039gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2040gitlab # [ 407.767834] nixbot[3472]: INFO: ::ffff:127.0.0.1:42018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2041gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2042gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2043gitlab # [ 408.821946] nixbot[3472]: INFO: ::ffff:127.0.0.1:42030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2044gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2045gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2046gitlab # [ 409.876464] nixbot[3472]: INFO: ::ffff:127.0.0.1:42038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2048gitlab # [ 410.754690] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:17.641Z","message":"Booted Rails 7.2.3.1 application in production environment"}2049gitlab # [ 410.757580] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:17.644Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2050gitlab # [ 410.759661] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:17.644Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2051gitlab # [ 410.761659] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:17.644Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2052gitlab # [ 410.763725] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:17.647Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2053gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2054gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2055gitlab # [ 410.930436] nixbot[3472]: INFO: ::ffff:127.0.0.1:54382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2057gitlab # [ 411.992644] nixbot[3472]: INFO: ::ffff:127.0.0.1:54390 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.07 seconds)2059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2060gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.05 seconds)2061gitlab # [ 413.049148] nixbot[3472]: INFO: ::ffff:127.0.0.1:54394 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2062gitlab # [ 413.455176] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:20.341Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"66fbed3364b1d8014f10e0d9","created_at":"2026-08-15T23:46:49.639Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:49.697Z","job_size_bytes":2,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-66fbed3364b1d8014f10e0d9: start","job_status":"start","queue_duration_s":90.643824,"scheduling_latency_s":90.64392}2063gitlab # [ 413.845993] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:20.732Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"66fbed3364b1d8014f10e0d9","created_at":"2026-08-15T23:46:49.639Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:49.697Z","job_size_bytes":2,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-66fbed3364b1d8014f10e0d9: done: 0.392203 sec","job_status":"done","queue_duration_s":90.643824,"scheduling_latency_s":90.64392,"redis_calls":23,"redis_duration_s":0.010704,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005866,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002696,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002142,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2012141,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.392203,"completed_at":"2026-08-15T23:48:20.732Z","load_balancing_strategy":"primary","db_duration_s":0.107771,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2064gitlab # [ 413.946732] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:20.735Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"803f3a9f9dc083f39ca01672","created_at":"2026-08-15T23:46:49.717Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:49.727Z","job_size_bytes":2,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-803f3a9f9dc083f39ca01672: start","job_status":"start","queue_duration_s":91.008476,"scheduling_latency_s":91.00851}2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2066gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)2067gitlab # [ 414.030086] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:20.917Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"803f3a9f9dc083f39ca01672","created_at":"2026-08-15T23:46:49.717Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:49.727Z","job_size_bytes":2,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-803f3a9f9dc083f39ca01672: done: 0.181213 sec","job_status":"done","queue_duration_s":91.008476,"scheduling_latency_s":91.00851,"redis_calls":14,"redis_duration_s":0.005183,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001001,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002537,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001645,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.133035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13854365999999999,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.181213,"completed_at":"2026-08-15T23:48:20.917Z","load_balancing_strategy":"primary","db_duration_s":0.037022,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2068gitlab # [ 414.135543] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:20.919Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"fd623b4c7e6a04ca036b5cb1","created_at":"2026-08-15T23:46:50.403Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:50.411Z","job_size_bytes":5,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-fd623b4c7e6a04ca036b5cb1: start","job_status":"start","queue_duration_s":90.508081,"scheduling_latency_s":90.508109}2069gitlab # [ 414.163155] nixbot[3472]: INFO: ::ffff:127.0.0.1:54398 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2070gitlab # [ 414.270727] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:21.158Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"fd623b4c7e6a04ca036b5cb1","created_at":"2026-08-15T23:46:50.403Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:50.411Z","job_size_bytes":5,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-fd623b4c7e6a04ca036b5cb1: done: 0.238412 sec","job_status":"done","queue_duration_s":90.508081,"scheduling_latency_s":90.508109,"redis_calls":12,"redis_duration_s":0.003885,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000919,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002293,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000673,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.182517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004274,"duration_s":0.238412,"completed_at":"2026-08-15T23:48:21.158Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047619,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2071gitlab # [ 414.366061] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:21.160Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d1fcbd8d148b0a4e770e1506","created_at":"2026-08-15T23:46:50.445Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:50.451Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d1fcbd8d148b0a4e770e1506: start","job_status":"start","queue_duration_s":90.708173,"scheduling_latency_s":90.708192}2072gitlab # [ 414.557864] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:21.443Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d1fcbd8d148b0a4e770e1506","created_at":"2026-08-15T23:46:50.445Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:50.451Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d1fcbd8d148b0a4e770e1506: done: 0.283524 sec","job_status":"done","queue_duration_s":90.708173,"scheduling_latency_s":90.708192,"redis_calls":11,"redis_duration_s":0.003993,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000882,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.23,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.23,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00099224,"duration_s":0.283524,"completed_at":"2026-08-15T23:48:21.443Z","load_balancing_strategy":"primary","db_duration_s":0.10456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2073gitlab # [ 414.655653] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:21.447Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bf82652cd2b417f805b79e9d","created_at":"2026-08-15T23:46:50.455Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:50.461Z","job_size_bytes":89,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bf82652cd2b417f805b79e9d: start","job_status":"start","queue_duration_s":90.986024,"scheduling_latency_s":90.986069}2074gitlab # [ 414.678537] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:21.535Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bf82652cd2b417f805b79e9d","created_at":"2026-08-15T23:46:50.455Z","trace_propagation_headers":{"sentry-trace":"2c3879b8f5314ceeb58cda85052a6d62-4bf8d542843b4801","baggage":"sentry-trace_id=2c3879b8f5314ceeb58cda85052a6d62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X47EVH3VGNC3T1PGTSMS3","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:50.461Z","job_size_bytes":89,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bf82652cd2b417f805b79e9d: done: 0.088247 sec","job_status":"done","queue_duration_s":90.986024,"scheduling_latency_s":90.986069,"redis_calls":11,"redis_duration_s":0.004788,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001207,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00093878,"duration_s":0.088247,"completed_at":"2026-08-15T23:48:21.535Z","load_balancing_strategy":"primary","db_duration_s":0.009966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab # [ 414.733460] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:21.538Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 dd3a78d90f61d83b3a1662fecd5cecd3299a1794 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b4006373abb2a573b1b48902","created_at":"2026-08-15T23:46:52.765Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-b698437b8aad4f87","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:52.775Z","job_size_bytes":185,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b4006373abb2a573b1b48902: start","job_status":"start","queue_duration_s":88.763186,"scheduling_latency_s":88.763227}2076gitlab # [ 414.750669] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:21.580Z","message":"changes: \"0000000000000000000000000000000000000000 dd3a78d90f61d83b3a1662fecd5cecd3299a1794 refs/heads/master\\n\""}2077gitlab # [ 414.774168] gitaly[910]: time="2026-08-15T23:48:21.661Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:31.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:21.642" grpc.time_ms=19.041 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 414.805670] gitaly[910]: time="2026-08-15T23:48:21.693Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:48:31.031" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:21.672" grpc.time_ms=20.534 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2079gitlab # [ 414.919356] gitaly[910]: time="2026-08-15T23:48:21.806Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-15T23:48:31.145" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:21.785" grpc.time_ms=21.242 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab # [ 415.002238] gitaly[910]: time="2026-08-15T23:48:21.890Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:21.889" grpc.time_ms=0.829 pid=910 span.kind=server system=grpc2081gitlab # [ 415.058071] gitaly[910]: time="2026-08-15T23:48:21.945Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:21.944" grpc.time_ms=0.849 pid=910 span.kind=server system=grpc2082gitlab # [ 415.087112] gitaly[910]: time="2026-08-15T23:48:21.960Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM diskcache=e0e7d97c-1122-4517-a4c1-f516414a62a0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:48:31.188" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:21.829" pid=910 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2083gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2084gitlab # [ 415.109235] gitaly[910]: time="2026-08-15T23:48:21.961Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=144 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4984 command.oublock=8 command.real_time_ms=123 command.spawn_token_fork_ms=1 command.system_time_ms=61 command.user_time_ms=83 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:48:31.188" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:21.829" grpc.time_ms=131.399 pid=910 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2085gitlab # [ 415.130306] gitaly[910]: time="2026-08-15T23:48:21.992Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T23:48:31.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:21.992" grpc.time_ms=0.322 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 415.145679] gitaly[910]: time="2026-08-15T23:48:22.028Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=858 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-15T23:48:31.009" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:22.000" grpc.time_ms=27.66 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 415.169146] nixbot[3472]: INFO: ::ffff:127.0.0.1:54400 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2088gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)2089gitlab # [ 415.324679] gitaly[910]: time="2026-08-15T23:48:22.212Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-15T23:48:52.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:22.200" grpc.time_ms=11.948 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 415.390806] gitaly[910]: time="2026-08-15T23:48:22.278Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:48:32.007" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:22.277" grpc.time_ms=0.567 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab # [ 415.423361] gitaly[910]: time="2026-08-15T23:48:22.295Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-15T23:48:32.012" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-15T23:48:22.283" grpc.time_ms=11.732 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab # [ 415.456497] gitaly[910]: time="2026-08-15T23:48:22.341Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:32.053" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:22.323" grpc.time_ms=17.661 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 415.483020] gitaly[910]: time="2026-08-15T23:48:22.370Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:32.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:22.352" grpc.time_ms=17.731 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2094gitlab # [ 415.537330] gitaly[910]: time="2026-08-15T23:48:22.425Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T23:48:52.295" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:22.395" grpc.time_ms=28.911 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095gitlab # [ 416.108105] gitaly[910]: time="2026-08-15T23:48:22.995Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-15T23:48:32.002" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:22.993" grpc.time_ms=2.134 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2097gitlab # [ 416.178478] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.064Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 dd3a78d90f61d83b3a1662fecd5cecd3299a1794 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b4006373abb2a573b1b48902","created_at":"2026-08-15T23:46:52.765Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-b698437b8aad4f87","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:52.775Z","job_size_bytes":185,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b4006373abb2a573b1b48902: done: 1.525439 sec","job_status":"done","queue_duration_s":88.763186,"scheduling_latency_s":88.763227,"gitaly_calls":13,"gitaly_duration_s":0.377206,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.070162,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.006826,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009872,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.00223,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004975,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.031524,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.014735,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.089,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.31,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.362,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.089,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.003594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00146928,"exclusive_lock_hold_duration_s":0.056735919999999995,"duration_s":1.525439,"completed_at":"2026-08-15T23:48:23.064Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.154152,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2098gitlab # [ 416.256838] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.067Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","dd3a78d90f61d83b3a1662fecd5cecd3299a1794 0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"047a03b75505992ecbc96565","created_at":"2026-08-15T23:46:58.508Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-7a45bc2d10824a62","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:58.514Z","job_size_bytes":185,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-047a03b75505992ecbc96565: start","job_status":"start","queue_duration_s":84.552847,"scheduling_latency_s":84.552892}2099gitlab # [ 416.274512] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.102Z","message":"changes: \"dd3a78d90f61d83b3a1662fecd5cecd3299a1794 0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 refs/heads/master\\n\""}2100gitlab # [ 416.278719] nixbot[3472]: INFO: ::ffff:127.0.0.1:54416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2101gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.11 seconds)2102gitlab # [ 416.280784] gitaly[910]: time="2026-08-15T23:48:23.166Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:33.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:23.149" grpc.time_ms=17.078 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 416.305655] gitaly[910]: time="2026-08-15T23:48:23.193Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T23:48:33.035" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:23.176" grpc.time_ms=17.04 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 416.323856] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.201Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"58f96e7bd36683193aef08d9","created_at":"2026-08-15T23:48:23.198Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-1eeb5c4c856c49aa","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"82e2c72f3adad46f9b87c70f","job_size_bytes":46,"pid":3375,"job_status":"deduplicated","message":"ProjectCacheWorker JID-58f96e7bd36683193aef08d9: deduplicated: until executing","deduplication.type":"until executing"}2105gitlab # [ 416.357992] gitaly[910]: time="2026-08-15T23:48:23.245Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-15T23:48:33.087" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:23.228" grpc.time_ms=17.194 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 416.386101] gitaly[910]: time="2026-08-15T23:48:23.273Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-15T23:48:53.154" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:23.255" grpc.time_ms=18.668 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 416.416820] gitaly[910]: time="2026-08-15T23:48:23.304Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-15T23:48:33.023" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-15T23:48:23.294" grpc.time_ms=10.246 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 416.451027] gitaly[910]: time="2026-08-15T23:48:23.338Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:33.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:23.321" grpc.time_ms=17.123 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 416.747016] gitaly[910]: time="2026-08-15T23:48:23.634Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-15T23:48:33.228" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:23.499" grpc.time_ms=135.598 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 416.785286] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.665Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","dd3a78d90f61d83b3a1662fecd5cecd3299a1794 0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"047a03b75505992ecbc96565","created_at":"2026-08-15T23:46:58.508Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-7a45bc2d10824a62","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T23:46:58.514Z","job_size_bytes":185,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-047a03b75505992ecbc96565: done: 0.598022 sec","job_status":"done","queue_duration_s":84.552847,"scheduling_latency_s":84.552892,"gitaly_calls":7,"gitaly_duration_s":0.264273,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.040319,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.004556,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001458,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006394,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.014655,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013256,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.043,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.043,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.418546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00157952,"exclusive_lock_hold_duration_s":0.04258486,"duration_s":0.598022,"completed_at":"2026-08-15T23:48:23.665Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042273,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2111gitlab # [ 416.880329] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.667Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3295b0bcdabd2588aabb4869","created_at":"2026-08-15T23:46:59.138Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-93b5d591734b4f10","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:59.147Z","job_size_bytes":65,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3295b0bcdabd2588aabb4869: start","job_status":"start","queue_duration_s":84.520245,"scheduling_latency_s":84.520276}2112gitlab # [ 416.926727] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.786Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3295b0bcdabd2588aabb4869","created_at":"2026-08-15T23:46:59.138Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-93b5d591734b4f10","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:59.147Z","job_size_bytes":65,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3295b0bcdabd2588aabb4869: done: 0.118647 sec","job_status":"done","queue_duration_s":84.520245,"scheduling_latency_s":84.520276,"redis_calls":16,"redis_duration_s":0.00528,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002761,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056646,"duration_s":0.118647,"completed_at":"2026-08-15T23:48:23.786Z","load_balancing_strategy":"primary","db_duration_s":0.036052,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2113gitlab # [ 417.004091] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.788Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"25c2d2098c002088a50d935e","created_at":"2026-08-15T23:46:59.150Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-93b5d591734b4f10","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:59.158Z","job_size_bytes":65,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-25c2d2098c002088a50d935e: start","job_status":"start","queue_duration_s":84.630056,"scheduling_latency_s":84.630086}2114gitlab # [ 417.058291] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.945Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"25c2d2098c002088a50d935e","created_at":"2026-08-15T23:46:59.150Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-93b5d591734b4f10","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:59.158Z","job_size_bytes":65,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-25c2d2098c002088a50d935e: done: 0.156735 sec","job_status":"done","queue_duration_s":84.630056,"scheduling_latency_s":84.630086,"redis_calls":21,"redis_duration_s":0.006806,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003112,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001944,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055604,"duration_s":0.156735,"completed_at":"2026-08-15T23:48:23.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115gitlab # [ 417.135992] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:23.947Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"cd7d5dad9fcd01e6b22f709c","created_at":"2026-08-15T23:46:59.338Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-93b5d591734b4f10","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:59.345Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cd7d5dad9fcd01e6b22f709c: start","job_status":"start","queue_duration_s":84.601771,"scheduling_latency_s":84.601794}2116gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2117gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.06 seconds)2118gitlab # [ 417.332138] gitaly[910]: time="2026-08-15T23:48:24.218Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:24.217" grpc.time_ms=0.775 pid=910 span.kind=server system=grpc2119gitlab # [ 417.362234] nixbot[3472]: INFO: ::ffff:127.0.0.1:54430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2120gitlab # [ 417.397695] gitaly[910]: time="2026-08-15T23:48:24.285Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:24.284" grpc.time_ms=0.936 pid=910 span.kind=server system=grpc2121gitlab # [ 417.451797] gitaly[910]: time="2026-08-15T23:48:24.339Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:24.337" grpc.time_ms=2.082 pid=910 span.kind=server system=grpc2122gitlab # [ 417.482394] gitaly[910]: time="2026-08-15T23:48:24.355Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V diskcache=8406a94c-62ef-4e6d-b9e8-5b67edd577b6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:48:54.054" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:24.155" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 417.509314] gitaly[910]: time="2026-08-15T23:48:24.356Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=205 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7539 command.oublock=0 command.real_time_ms=193 command.spawn_token_fork_ms=1 command.system_time_ms=98 command.user_time_ms=107 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:48:54.054" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:24.155" grpc.time_ms=200.706 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 417.694951] gitaly[910]: time="2026-08-15T23:48:24.582Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:48:54.480" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:24.580" grpc.time_ms=1.601 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 417.782479] gitaly[910]: time="2026-08-15T23:48:24.670Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4M195JAWJWY7N3HGMM4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:54.567" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:24.668" grpc.time_ms=1.362 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 417.824907] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:24.710Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"cd7d5dad9fcd01e6b22f709c","created_at":"2026-08-15T23:46:59.338Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-93b5d591734b4f10","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:46:59.345Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cd7d5dad9fcd01e6b22f709c: done: 0.763149 sec","job_status":"done","queue_duration_s":84.601771,"scheduling_latency_s":84.601794,"gitaly_calls":3,"gitaly_duration_s":0.21679,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.042318,"redis_read_bytes":457,"redis_write_bytes":27999,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001727,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002431,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.015658,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006021,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14493,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.008643,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000886,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000975,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00425,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.1,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.035,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.04,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.051,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.417519,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.66301358,"duration_s":0.763149,"completed_at":"2026-08-15T23:48:24.710Z","load_balancing_strategy":"primary","db_duration_s":0.11664,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2127gitlab # [ 417.921392] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:24.713Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"82e2c72f3adad46f9b87c70f","created_at":"2026-08-15T23:48:21.698Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:21.734Z","job_size_bytes":46,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-82e2c72f3adad46f9b87c70f: start","job_status":"start","queue_duration_s":2.979177,"scheduling_latency_s":2.979213}2128gitlab # [ 417.938363] gitaly[910]: time="2026-08-15T23:48:24.806Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T05:48:24.794" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:24.795" grpc.time_ms=10.369 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 417.948969] gitaly[910]: time="2026-08-15T23:48:24.835Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-15T23:48:54.717" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:24.818" grpc.time_ms=17.263 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 417.989686] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:24.876Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"82e2c72f3adad46f9b87c70f","created_at":"2026-08-15T23:48:21.698Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:21.734Z","job_size_bytes":46,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-82e2c72f3adad46f9b87c70f: done: 0.163103 sec","job_status":"done","queue_duration_s":2.979177,"scheduling_latency_s":2.979213,"gitaly_calls":2,"gitaly_duration_s":0.034168,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010429,"redis_read_bytes":69,"redis_write_bytes":4885,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002173,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000808,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002207,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004058,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001183,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043358,"duration_s":0.163103,"completed_at":"2026-08-15T23:48:24.876Z","load_balancing_strategy":"primary","db_duration_s":0.018991,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2131gitlab # [ 418.066902] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:24.879Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5da561f89b115faf03d92b68","created_at":"2026-08-15T23:48:21.767Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:21.777Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5da561f89b115faf03d92b68: start","job_status":"start","queue_duration_s":3.101002,"scheduling_latency_s":3.101026}2132gitlab # [ 418.087230] gitaly[910]: time="2026-08-15T23:48:24.950Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM diskcache=e9f17784-91e0-4ec9-8fe1-31ba2c479e8d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:48:24.909" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:24.910" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 418.099405] gitaly[910]: time="2026-08-15T23:48:24.951Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=47 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:48:24.909" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:24.910" grpc.time_ms=40.156 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 418.146556] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:25.033Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5da561f89b115faf03d92b68","created_at":"2026-08-15T23:48:21.767Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:21.777Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5da561f89b115faf03d92b68: done: 0.154494 sec","job_status":"done","queue_duration_s":3.101002,"scheduling_latency_s":3.101026,"gitaly_calls":1,"gitaly_duration_s":0.043566,"redis_calls":15,"redis_duration_s":0.00541,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000688,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000818,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001654,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.021,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.043,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11580715999999999,"duration_s":0.154494,"completed_at":"2026-08-15T23:48:25.033Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2135gitlab # [ 418.207760] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:25.036Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6736c04f659fcb7b2c911efc","created_at":"2026-08-15T23:48:21.982Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:21.986Z","job_size_bytes":23,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6736c04f659fcb7b2c911efc: start","job_status":"start","queue_duration_s":3.049445,"scheduling_latency_s":3.049481}2136gitlab # [ 418.224215] gitaly[910]: time="2026-08-15T23:48:25.098Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-15T23:48:55.082" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:25.083" grpc.time_ms=15.284 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 418.237098] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:25.113Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6736c04f659fcb7b2c911efc","created_at":"2026-08-15T23:48:21.982Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:21.986Z","job_size_bytes":23,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6736c04f659fcb7b2c911efc: done: 0.076976 sec","job_status":"done","queue_duration_s":3.049445,"scheduling_latency_s":3.049481,"gitaly_calls":1,"gitaly_duration_s":0.019012,"redis_calls":16,"redis_duration_s":0.005429,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000418,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002481,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076976,"completed_at":"2026-08-15T23:48:25.113Z","load_balancing_strategy":"primary","db_duration_s":0.004874,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2138gitlab # [ 418.282382] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:25.115Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fa28ec78fc417b29409c4e23","created_at":"2026-08-15T23:48:22.804Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:daab9636867daac99dd7dc60b3f4264dde5da605e5c2900c283c0f2af38ee7b7","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:22.810Z","job_size_bytes":467,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fa28ec78fc417b29409c4e23: start","job_status":"start","queue_duration_s":2.305311,"scheduling_latency_s":2.305341}2139gitlab # [ 418.299814] gitaly[910]: time="2026-08-15T23:48:25.155Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:55.153" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:25.154" grpc.time_ms=1.006 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 418.312159] gitaly[910]: time="2026-08-15T23:48:25.175Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:48:35.018" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:25.158" grpc.time_ms=16.214 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2142gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.07 seconds)2143gitlab # [ 418.414562] nixbot[3472]: INFO: ::ffff:127.0.0.1:54434 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2144gitlab # [ 418.526876] gitaly[910]: time="2026-08-15T23:48:25.414Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:48:55.412" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:25.412" grpc.time_ms=1.498 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 418.543540] gitaly[910]: time="2026-08-15T23:48:25.427Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=34 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-15T23:48:55.422" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:25.422" grpc.time_ms=4.243 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 418.726094] gitaly[910]: time="2026-08-15T23:48:25.613Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:35.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:25.595" grpc.time_ms=17.739 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 419.371122] gitaly[910]: time="2026-08-15T23:48:26.258Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T23:48:56.231" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:26.232" grpc.time_ms=26.296 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2149gitlab # [ 419.414594] gitaly[910]: time="2026-08-15T23:48:26.288Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X4CSH7EDVT5CWK6YVRVDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-15T23:48:56.264" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:26.264" grpc.time_ms=24.216 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 419.459097] nixbot[3472]: INFO: ::ffff:127.0.0.1:54448 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2151gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.04 seconds)2152gitlab # [ 419.468455] sidekiq-cluster[3375]: {"severity":"WARN","time":"2026-08-15T23:48:26.355Z","class":"CreatePipelineWorker","correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"dd3a78d90f61d83b3a1662fecd5cecd3299a1794","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"dd3a78d90f61d83b3a1662fecd5cecd3299a1794","ref":"refs/heads/master"},"retry":0}2153gitlab # [ 419.485707] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:26.369Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fa28ec78fc417b29409c4e23","created_at":"2026-08-15T23:48:22.804Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:daab9636867daac99dd7dc60b3f4264dde5da605e5c2900c283c0f2af38ee7b7","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:22.810Z","job_size_bytes":467,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fa28ec78fc417b29409c4e23: done: 1.253815 sec","job_status":"done","queue_duration_s":2.305311,"scheduling_latency_s":2.305341,"gitaly_calls":7,"gitaly_duration_s":0.116781,"redis_calls":51,"redis_duration_s":0.015098,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001477,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006194,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002013,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003794,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00162,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.060228,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051926,"duration_s":1.253815,"completed_at":"2026-08-15T23:48:26.369Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.085823,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2154gitlab # [ 419.553542] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:26.372Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"6ddb61d4-956c-4c71-b907-8427ce4331b9\"}"],"class":"WebHookWorker","jid":"dfd1224b8531a743d36b494f","created_at":"2026-08-15T23:48:22.952Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bf6d6e4571417290d76f0dba7f2932eb3a6f9d25c10f247ad1fdd16eb9d6603a","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:22.962Z","job_size_bytes":1751,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dfd1224b8531a743d36b494f: start","job_status":"start","queue_duration_s":3.410499,"scheduling_latency_s":3.410537}2155gitlab # [ 419.691177] nixbot[3472]: INFO: ::ffff:127.0.0.1:54464 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2156gitlab # [ 419.733121] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:26.619Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"6ddb61d4-956c-4c71-b907-8427ce4331b9\"}"],"class":"WebHookWorker","jid":"dfd1224b8531a743d36b494f","created_at":"2026-08-15T23:48:22.952Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-fb8fcdbb3f6140d3","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bf6d6e4571417290d76f0dba7f2932eb3a6f9d25c10f247ad1fdd16eb9d6603a","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:22.962Z","job_size_bytes":1751,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dfd1224b8531a743d36b494f: done: 0.246995 sec","job_status":"done","queue_duration_s":3.410499,"scheduling_latency_s":3.410537,"redis_calls":19,"redis_duration_s":0.00713,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001755,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000892,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002902,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001581,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08773810000002413,"cpu_s":0.1354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077046,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.246995,"completed_at":"2026-08-15T23:48:26.619Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00519,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab # [ 419.846787] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:26.623Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"2d9eba3c15e9989a7975b391","created_at":"2026-08-15T23:48:23.214Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-1eeb5c4c856c49aa","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5da561f89b115faf03d92b68","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:23.220Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-2d9eba3c15e9989a7975b391: start","job_status":"start","queue_duration_s":3.402576,"scheduling_latency_s":3.402613}2158gitlab # [ 419.871014] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:26.703Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"2d9eba3c15e9989a7975b391","created_at":"2026-08-15T23:48:23.214Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-1eeb5c4c856c49aa","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5da561f89b115faf03d92b68","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:23.220Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-2d9eba3c15e9989a7975b391: done: 0.080824 sec","job_status":"done","queue_duration_s":3.402576,"scheduling_latency_s":3.402613,"gitaly_calls":1,"gitaly_duration_s":0.016939,"redis_calls":12,"redis_duration_s":0.007444,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003585,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001309,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04306472,"duration_s":0.080824,"completed_at":"2026-08-15T23:48:26.703Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2159gitlab # [ 419.926090] gitaly[910]: time="2026-08-15T23:48:26.671Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A diskcache=347d0369-bf67-4865-90aa-1d1eedface82 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:48:26.657" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:26.658" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 419.936136] gitaly[910]: time="2026-08-15T23:48:26.671Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T05:48:26.657" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:26.658" grpc.time_ms=13.338 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 419.949325] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:26.706Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"94c33194da4d73e97a370de4","created_at":"2026-08-15T23:48:23.440Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-1eeb5c4c856c49aa","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9efbc05a8b28aa6c5be36b2a1f7321d16944da5c1251d1587ef750507c40ee3d","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:23.445Z","job_size_bytes":467,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-94c33194da4d73e97a370de4: start","job_status":"start","queue_duration_s":3.260494,"scheduling_latency_s":3.260527}2162gitlab # [ 419.966728] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1942163gitlab # [ 419.968908] gitaly[910]: time="2026-08-15T23:48:26.745Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:56.743" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:26.744" grpc.time_ms=0.714 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 419.981493] gitaly[910]: time="2026-08-15T23:48:26.758Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:48:36.157" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:26.748" grpc.time_ms=9.958 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 419.994680] gitaly[910]: time="2026-08-15T23:48:26.806Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:48:56.805" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:26.805" grpc.time_ms=0.927 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 420.007268] gitaly[910]: time="2026-08-15T23:48:26.816Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=32 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-15T23:48:56.810" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:26.810" grpc.time_ms=6.016 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 420.023745] gitaly[910]: time="2026-08-15T23:48:26.823Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X79W5E6D469TZQAG8B29R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:26.803" grpc.time_ms=20.209 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2168gitlab # [ 420.037268] gitaly[910]: time="2026-08-15T23:48:26.872Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:36.267" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:26.857" grpc.time_ms=14.299 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 420.062094] gitaly[910]: time="2026-08-15T23:48:26.949Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7A29TPFNA3VKZBFDJSP7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:26.938" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2170gitlab # [ 420.072500] gitaly[910]: time="2026-08-15T23:48:26.950Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7A29TPFNA3VKZBFDJSP7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:26.938" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2171gitlab # [ 420.086021] gitlab-workhorse[820]: time="2026-08-15T23:48:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672172gitlab # [ 420.087883] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1252173gitlab # [ 420.090015] gitaly[910]: time="2026-08-15T23:48:26.951Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7A29TPFNA3VKZBFDJSP7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:26.938" grpc.time_ms=11.908 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2174gitlab # [ 420.120243] nixbot[3472]: {"ts": "2026-08-15T23:48:27.007Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2175gitlab # [ 420.244530] gitaly[910]: time="2026-08-15T23:48:27.132Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7A8H0KASNBY69YGKQRG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:57.130" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:27.130" grpc.time_ms=1.189 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 420.360269] gitaly[910]: time="2026-08-15T23:48:27.247Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X7A8H0KASNBY69YGKQRG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:37.139" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:27.229" grpc.time_ms=18.194 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 420.446599] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3082178gitlab # [ 420.454709] nixbot[3472]: {"ts": "2026-08-15T23:48:27.335Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 \"HTTP/1.1 201 Created\""}2179gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2180gitlab # [ 420.530714] nixbot[3472]: INFO: ::ffff:127.0.0.1:54472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2181gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.08 seconds)2182gitlab # [ 420.608790] gitaly[910]: time="2026-08-15T23:48:27.496Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7AJB7298RW5TAETWX14D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:57.394" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:27.495" grpc.time_ms=1.086 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 420.688556] gitaly[910]: time="2026-08-15T23:48:27.576Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T23:48:57.549" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:27.549" grpc.time_ms=26.833 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 420.729936] gitaly[910]: time="2026-08-15T23:48:27.608Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M03X4K0BTBVHBQ1EE27BBA9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-15T23:48:57.582" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:27.582" grpc.time_ms=26.413 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2185gitlab # [ 420.753110] gitaly[910]: time="2026-08-15T23:48:27.609Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X7AJB7298RW5TAETWX14D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:37.280" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:27.600" grpc.time_ms=8.393 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab # [ 420.772644] sidekiq-cluster[3375]: {"severity":"WARN","time":"2026-08-15T23:48:27.633Z","class":"CreatePipelineWorker","correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"dd3a78d90f61d83b3a1662fecd5cecd3299a1794","after":"0609b2d3ab4f236ca72cc86a12579eda4d9f41f1","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"0609b2d3ab4f236ca72cc86a12579eda4d9f41f1","ref":"refs/heads/master"},"retry":0}2187gitlab # [ 420.782189] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.644Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"94c33194da4d73e97a370de4","created_at":"2026-08-15T23:48:23.440Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-1eeb5c4c856c49aa","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9efbc05a8b28aa6c5be36b2a1f7321d16944da5c1251d1587ef750507c40ee3d","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:23.445Z","job_size_bytes":467,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-94c33194da4d73e97a370de4: done: 0.938726 sec","job_status":"done","queue_duration_s":3.260494,"scheduling_latency_s":3.260527,"gitaly_calls":7,"gitaly_duration_s":0.106022,"redis_calls":33,"redis_duration_s":0.011139,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000676,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.006655,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001636,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.801534,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.938726,"completed_at":"2026-08-15T23:48:27.644Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031435,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2188gitlab # [ 420.843835] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3292189gitlab # [ 420.846919] nixbot[3472]: {"ts": "2026-08-15T23:48:27.670Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 \"HTTP/1.1 201 Created\""}2190gitlab # [ 420.850018] nixbot[3472]: INFO: ::ffff:127.0.0.1:54474 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2191gitlab # [ 420.851345] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.647Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7a512ad0-cabc-4031-b059-b3373ff49ad3\"}"],"class":"WebHookWorker","jid":"957de2ef61fba921c833c8be","created_at":"2026-08-15T23:48:23.472Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-1eeb5c4c856c49aa","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3760622fb7ff124cd159c3a702ae3aa29a3256036197aac54617d4924e7c794","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:23.476Z","job_size_bytes":1749,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-957de2ef61fba921c833c8be: start","job_status":"start","queue_duration_s":4.170864,"scheduling_latency_s":4.170903}2192gitlab # [ 420.869362] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.717Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7a512ad0-cabc-4031-b059-b3373ff49ad3\"}"],"class":"WebHookWorker","jid":"957de2ef61fba921c833c8be","created_at":"2026-08-15T23:48:23.472Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-1eeb5c4c856c49aa","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3760622fb7ff124cd159c3a702ae3aa29a3256036197aac54617d4924e7c794","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:23.476Z","job_size_bytes":1749,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-957de2ef61fba921c833c8be: done: 0.070041 sec","job_status":"done","queue_duration_s":4.170864,"scheduling_latency_s":4.170903,"redis_calls":14,"redis_duration_s":0.008517,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000635,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00572,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002162,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.00956284000000096,"cpu_s":0.04182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.070041,"completed_at":"2026-08-15T23:48:27.717Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2193gitlab # [ 420.917488] gitaly[910]: time="2026-08-15T23:48:27.731Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7AWWW5JDS66VPX4HVY9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:57.629" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:27.730" grpc.time_ms=1.245 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 420.930175] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.722Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bc9addaa88a3a7bd0fbd7259","created_at":"2026-08-15T23:48:24.131Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.139Z","job_size_bytes":23,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bc9addaa88a3a7bd0fbd7259: start","job_status":"start","queue_duration_s":3.582929,"scheduling_latency_s":3.582987}2195gitlab # [ 420.946885] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 732196gitlab # [ 420.949064] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1492197gitlab # [ 420.951871] gitaly[910]: time="2026-08-15T23:48:27.774Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M03X7AWWW5JDS66VPX4HVY9E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:37.035" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:27.765" grpc.time_ms=8.625 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab # [ 420.965694] nixbot[3472]: {"ts": "2026-08-15T23:48:27.828Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/dd3a78d90f61d83b3a1662fecd5cecd3299a1794 \"HTTP/1.1 201 Created\""}2199gitlab # [ 420.968450] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.850Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bc9addaa88a3a7bd0fbd7259","created_at":"2026-08-15T23:48:24.131Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.139Z","job_size_bytes":23,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bc9addaa88a3a7bd0fbd7259: done: 0.128218 sec","job_status":"done","queue_duration_s":3.582929,"scheduling_latency_s":3.582987,"redis_calls":10,"redis_duration_s":0.005965,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000605,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038072,"duration_s":0.128218,"completed_at":"2026-08-15T23:48:27.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018676,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 421.012770] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.852Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"481dd7789d4ea0c26941d7e8","created_at":"2026-08-15T23:48:24.365Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.379Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-481dd7789d4ea0c26941d7e8: start","job_status":"start","queue_duration_s":3.472404,"scheduling_latency_s":3.472425}2201gitlab # [ 421.029504] gitaly[910]: time="2026-08-15T23:48:27.816Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X7AYZ2NB16W0FQ3ZHTJ1A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:27.808" grpc.time_ms=8.607 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2202gitlab # [ 421.042503] gitaly[910]: time="2026-08-15T23:48:27.888Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7B1A1389MY58SCB2B8W2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:27.874" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2203gitlab # [ 421.053153] gitlab-workhorse[820]: time="2026-08-15T23:48:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672204gitlab # [ 421.054997] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 702205gitlab # [ 421.056993] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.894Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"481dd7789d4ea0c26941d7e8","created_at":"2026-08-15T23:48:24.365Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.379Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-481dd7789d4ea0c26941d7e8: done: 0.041917 sec","job_status":"done","queue_duration_s":3.472404,"scheduling_latency_s":3.472425,"redis_calls":10,"redis_duration_s":0.0026490000000000003,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022862,"duration_s":0.041917,"completed_at":"2026-08-15T23:48:27.894Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2206gitlab # [ 421.103223] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"97c29865f5f436e2f5d08c11","created_at":"2026-08-15T23:48:24.412Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.426Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-97c29865f5f436e2f5d08c11: start","job_status":"start","queue_duration_s":3.469224,"scheduling_latency_s":3.469241}2207gitlab # [ 421.119051] gitaly[910]: time="2026-08-15T23:48:27.888Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7B1A1389MY58SCB2B8W2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:27.874" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2208gitlab # [ 421.133035] nix-daemon[3694]: accepted connection from pid 4262, user nixbot2209gitlab # [ 421.134047] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.940Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"97c29865f5f436e2f5d08c11","created_at":"2026-08-15T23:48:24.412Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.426Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-97c29865f5f436e2f5d08c11: done: 0.044568 sec","job_status":"done","queue_duration_s":3.469224,"scheduling_latency_s":3.469241,"redis_calls":10,"redis_duration_s":0.001606,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022898,"duration_s":0.044568,"completed_at":"2026-08-15T23:48:27.940Z","load_balancing_strategy":"primary","db_duration_s":0.010397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2210gitlab # [ 421.177757] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.941Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4aecbf0395a629a7f12b67fe","created_at":"2026-08-15T23:48:24.458Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.470Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4aecbf0395a629a7f12b67fe: start","job_status":"start","queue_duration_s":3.470843,"scheduling_latency_s":3.470862}2211gitlab # [ 421.195031] gitaly[910]: time="2026-08-15T23:48:27.889Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7B1A1389MY58SCB2B8W2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:27.874" grpc.time_ms=14.185 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2212gitlab # [ 421.219268] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 952213gitlab # [ 421.222443] gitlab-workhorse[820]: time="2026-08-15T23:48:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672214gitlab # [ 421.225105] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 692215gitlab # [ 421.227776] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.985Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4aecbf0395a629a7f12b67fe","created_at":"2026-08-15T23:48:24.458Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.470Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4aecbf0395a629a7f12b67fe: done: 0.043758 sec","job_status":"done","queue_duration_s":3.470843,"scheduling_latency_s":3.470862,"redis_calls":13,"redis_duration_s":0.001957,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000335,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000328,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000304,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025568,"duration_s":0.043758,"completed_at":"2026-08-15T23:48:27.985Z","load_balancing_strategy":"primary","db_duration_s":0.007292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2216gitlab # [ 421.278155] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:27.987Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"05019959d3569d6b428ebde2","created_at":"2026-08-15T23:48:24.472Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.482Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-05019959d3569d6b428ebde2: start","job_status":"start","queue_duration_s":3.504686,"scheduling_latency_s":3.504705}2217gitlab # [ 421.294723] gitaly[910]: time="2026-08-15T23:48:28.020Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X7B4N2MGYQ7ENA9VVTJ2H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:28.012" grpc.time_ms=8.341 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2218gitlab # [ 421.309038] gitaly[910]: time="2026-08-15T23:48:28.091Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7B7PK3RTC751C5G1CQAY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:28.080" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2219gitlab # [ 421.319167] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.025Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"05019959d3569d6b428ebde2","created_at":"2026-08-15T23:48:24.472Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.482Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-05019959d3569d6b428ebde2: done: 0.037919 sec","job_status":"done","queue_duration_s":3.504686,"scheduling_latency_s":3.504705,"redis_calls":10,"redis_duration_s":0.003526,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000535,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023152,"duration_s":0.037919,"completed_at":"2026-08-15T23:48:28.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2220gitlab # [ 421.363774] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.027Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"178ef527350ec3db8fabf45d","created_at":"2026-08-15T23:48:24.483Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.494Z","job_size_bytes":19,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-178ef527350ec3db8fabf45d: start","job_status":"start","queue_duration_s":3.532453,"scheduling_latency_s":3.532471}2221gitlab # [ 421.380010] gitaly[910]: time="2026-08-15T23:48:28.091Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7B7PK3RTC751C5G1CQAY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:28.080" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2222gitlab # [ 421.394683] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 582223gitlab # [ 421.396879] gitlab-workhorse[820]: time="2026-08-15T23:48:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162224gitlab # [ 421.398743] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 732225gitlab # [ 421.400748] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.065Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"178ef527350ec3db8fabf45d","created_at":"2026-08-15T23:48:24.483Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.494Z","job_size_bytes":19,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-178ef527350ec3db8fabf45d: done: 0.038198 sec","job_status":"done","queue_duration_s":3.532453,"scheduling_latency_s":3.532471,"redis_calls":11,"redis_duration_s":0.007143,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000976,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003951,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002216,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062106,"duration_s":0.038198,"completed_at":"2026-08-15T23:48:28.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2226gitlab # [ 421.444974] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.067Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5ce472e7d7cabff8fc1b6e33","created_at":"2026-08-15T23:48:24.500Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.509Z","job_size_bytes":66,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5ce472e7d7cabff8fc1b6e33: start","job_status":"start","queue_duration_s":3.55785,"scheduling_latency_s":3.557869}2227gitlab # [ 421.462052] gitaly[910]: time="2026-08-15T23:48:28.092Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7B7PK3RTC751C5G1CQAY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:28.080" grpc.time_ms=11.32 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2228gitlab # [ 421.476163] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.104Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5ce472e7d7cabff8fc1b6e33","created_at":"2026-08-15T23:48:24.500Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.509Z","job_size_bytes":66,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5ce472e7d7cabff8fc1b6e33: done: 0.037275 sec","job_status":"done","queue_duration_s":3.55785,"scheduling_latency_s":3.557869,"redis_calls":10,"redis_duration_s":0.002678,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000377,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001951,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025984,"duration_s":0.037275,"completed_at":"2026-08-15T23:48:28.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2229gitlab # [ 421.523259] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"dde849391be6416447b93dd8","created_at":"2026-08-15T23:48:24.510Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.518Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-dde849391be6416447b93dd8: start","job_status":"start","queue_duration_s":3.587683,"scheduling_latency_s":3.587704}2230gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1'2231gitlab # [ 421.539481] gitaly[910]: time="2026-08-15T23:48:28.187Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X7BB259RMW88SAXCECKJQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:28.175" grpc.time_ms=11.564 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2232gitlab # [ 421.551837] gitaly[910]: time="2026-08-15T23:48:28.263Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BCZ39TPHDAEW5YDE6WV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:28.241" pid=910 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2233gitlab # [ 421.561269] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"dde849391be6416447b93dd8","created_at":"2026-08-15T23:48:24.510Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.518Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-dde849391be6416447b93dd8: done: 0.050786 sec","job_status":"done","queue_duration_s":3.587683,"scheduling_latency_s":3.587704,"redis_calls":10,"redis_duration_s":0.001827,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028148,"duration_s":0.050786,"completed_at":"2026-08-15T23:48:28.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 421.604093] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.158Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a4d17f263c8f3da8198ca38a","created_at":"2026-08-15T23:48:24.530Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.536Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a4d17f263c8f3da8198ca38a: start","job_status":"start","queue_duration_s":3.622389,"scheduling_latency_s":3.622413}2235gitlab # [ 421.620330] gitaly[910]: time="2026-08-15T23:48:28.263Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BCZ39TPHDAEW5YDE6WV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:28.241" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2236gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', in 0.12 seconds)2237(finished: subtest: push delivers the webhook, in 91.25 seconds)2238subtest: eval and build post commit statuses2239gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses2240gitlab # [ 421.633959] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.204Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a4d17f263c8f3da8198ca38a","created_at":"2026-08-15T23:48:24.530Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.536Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a4d17f263c8f3da8198ca38a: done: 0.046252 sec","job_status":"done","queue_duration_s":3.622389,"scheduling_latency_s":3.622413,"redis_calls":10,"redis_duration_s":0.001925,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000344,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000398,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029436,"duration_s":0.046252,"completed_at":"2026-08-15T23:48:28.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2241gitlab # [ 421.678465] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.206Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"076305638a6d278d9225c48d","created_at":"2026-08-15T23:48:24.537Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.543Z","job_size_bytes":6,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-076305638a6d278d9225c48d: start","job_status":"start","queue_duration_s":3.662769,"scheduling_latency_s":3.662786}2242gitlab # [ 421.694669] gitaly[910]: time="2026-08-15T23:48:28.264Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BCZ39TPHDAEW5YDE6WV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:28.241" grpc.time_ms=22.463 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2243gitlab # [ 421.710099] nixbot[3472]: INFO: ::ffff:127.0.0.1:37840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 200 OK2244gitlab # [ 421.712215] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.230Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"076305638a6d278d9225c48d","created_at":"2026-08-15T23:48:24.537Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.543Z","job_size_bytes":6,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-076305638a6d278d9225c48d: done: 0.023953 sec","job_status":"done","queue_duration_s":3.662769,"scheduling_latency_s":3.662786,"redis_calls":10,"redis_duration_s":0.001999,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000368,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002967,"duration_s":0.023953,"completed_at":"2026-08-15T23:48:28.230Z","load_balancing_strategy":"primary","db_duration_s":0.002937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2245gitlab # [ 421.757070] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.231Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"15f04c5fd3f34ffa40ec31bf","created_at":"2026-08-15T23:48:24.544Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.549Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-15f04c5fd3f34ffa40ec31bf: start","job_status":"start","queue_duration_s":3.682075,"scheduling_latency_s":3.68209}2246gitlab # [ 421.772456] gitaly[910]: time="2026-08-15T23:48:28.368Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:58.365" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:28.365" grpc.time_ms=2.467 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2247gitlab # [ 421.785562] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.276Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"15f04c5fd3f34ffa40ec31bf","created_at":"2026-08-15T23:48:24.544Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.549Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-15f04c5fd3f34ffa40ec31bf: done: 0.045257 sec","job_status":"done","queue_duration_s":3.682075,"scheduling_latency_s":3.68209,"redis_calls":10,"redis_duration_s":0.0025,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000577,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031132,"duration_s":0.045257,"completed_at":"2026-08-15T23:48:28.276Z","load_balancing_strategy":"primary","db_duration_s":0.013987,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2248gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses, in 0.18 seconds)2249gitlab # [ 421.829361] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.278Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"91046529ded31b9050a99565","created_at":"2026-08-15T23:48:24.557Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.563Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-91046529ded31b9050a99565: start","job_status":"start","queue_duration_s":3.715344,"scheduling_latency_s":3.71536}2250gitlab # [ 421.845440] gitaly[910]: time="2026-08-15T23:48:28.560Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-15T23:48:58.545" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:28.545" grpc.time_ms=15.55 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2251gitlab # [ 421.859635] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 1072252gitlab # [ 421.862453] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.380Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"91046529ded31b9050a99565","created_at":"2026-08-15T23:48:24.557Z","trace_propagation_headers":{"sentry-trace":"a228f1eb258045eabc483ccdc7b3ded8-4800ecea77a044ec","baggage":"sentry-trace_id=a228f1eb258045eabc483ccdc7b3ded8,sentry-release=Unknown"},"correlation_id":"01M03X4M195JAWJWY7N3HGMM4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.563Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-91046529ded31b9050a99565: done: 0.101628 sec","job_status":"done","queue_duration_s":3.715344,"scheduling_latency_s":3.71536,"redis_calls":14,"redis_duration_s":0.004471,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002268,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00186,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000665,"duration_s":0.101628,"completed_at":"2026-08-15T23:48:28.380Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022767,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2253gitlab # [ 421.907439] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.382Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"79c30f4bd6b6b574f2dfe9ca","created_at":"2026-08-15T23:48:24.849Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-8be5d68a5b1c49b2","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.857Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-79c30f4bd6b6b574f2dfe9ca: start","job_status":"start","queue_duration_s":3.524664,"scheduling_latency_s":3.52469}2254gitlab # [ 421.923970] gitaly[910]: time="2026-08-15T23:48:28.575Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:38.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:28.567" grpc.time_ms=7.341 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2255gitlab # [ 421.939001] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.464Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"79c30f4bd6b6b574f2dfe9ca","created_at":"2026-08-15T23:48:24.849Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-8be5d68a5b1c49b2","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:24.857Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-79c30f4bd6b6b574f2dfe9ca: done: 0.082014 sec","job_status":"done","queue_duration_s":3.524664,"scheduling_latency_s":3.52469,"redis_calls":19,"redis_duration_s":0.006627,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001435,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000881,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003001,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00131,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01330258,"duration_s":0.082014,"completed_at":"2026-08-15T23:48:28.464Z","load_balancing_strategy":"primary","db_duration_s":0.013724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2256gitlab # [ 421.984275] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.466Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dfd1224b8531a743d36b494f"],"class":"WebHooks::LogExecutionWorker","jid":"c6464df9bd4e4274174547d0","created_at":"2026-08-15T23:48:26.584Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-1d16873c025944b0","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2d8f04b62c87dfb923478d491794322b8292608f22e2af99abf87316791d308a","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:26.598Z","job_size_bytes":2593,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c6464df9bd4e4274174547d0: start","job_status":"start","queue_duration_s":1.868277,"scheduling_latency_s":1.868305}2257gitlab # [ 422.001259] gitaly[910]: time="2026-08-15T23:48:28.617Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T23:48:38.056" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:28.617" grpc.time_ms=0.23 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 422.012062] nixbot[3472]: {"ts": "2026-08-15T23:48:28.844Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 \"HTTP/1.1 201 Created\""}2259gitlab # [ 422.014680] nixbot[3472]: {"ts": "2026-08-15T23:48:28.854Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-0609b2d3ab4f-4"}2260gitlab # [ 422.016977] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.538Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dfd1224b8531a743d36b494f"],"class":"WebHooks::LogExecutionWorker","jid":"c6464df9bd4e4274174547d0","created_at":"2026-08-15T23:48:26.584Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-1d16873c025944b0","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2d8f04b62c87dfb923478d491794322b8292608f22e2af99abf87316791d308a","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:26.598Z","job_size_bytes":2593,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-c6464df9bd4e4274174547d0: done: 0.072044 sec","job_status":"done","queue_duration_s":1.868277,"scheduling_latency_s":1.868305,"redis_calls":10,"redis_duration_s":0.0019379999999999998,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000427,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028232,"duration_s":0.072044,"completed_at":"2026-08-15T23:48:28.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 422.061747] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.540Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f7371cf1ceb6a59a4b513620","created_at":"2026-08-15T23:48:27.300Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-8887212b1a114409","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:27.309Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f7371cf1ceb6a59a4b513620: start","job_status":"start","queue_duration_s":1.230747,"scheduling_latency_s":1.230773}2262gitlab # [ 422.078079] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5352263gitlab # [ 422.080597] gitaly[910]: time="2026-08-15T23:48:28.639Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T23:48:38.063" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:28.623" grpc.time_ms=15.799 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2264gitlab # [ 422.093649] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.869Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f7371cf1ceb6a59a4b513620","created_at":"2026-08-15T23:48:27.300Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-8887212b1a114409","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:27.309Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3375,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f7371cf1ceb6a59a4b513620: rescheduled"}2265gitlab # [ 422.108718] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.878Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f7371cf1ceb6a59a4b513620","created_at":"2026-08-15T23:48:27.300Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-8887212b1a114409","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:27.309Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f7371cf1ceb6a59a4b513620: done: 0.338 sec","job_status":"done","queue_duration_s":1.230747,"scheduling_latency_s":1.230773,"gitaly_calls":3,"gitaly_duration_s":0.113939,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.02113,"redis_read_bytes":150,"redis_write_bytes":18013,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.004448,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000837,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003867,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005173,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000263,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000349,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.160868,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.27074064,"duration_s":0.338,"completed_at":"2026-08-15T23:48:28.878Z","load_balancing_strategy":"primary","db_duration_s":0.054476,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2266gitlab # [ 422.160722] nix-daemon[3694]: accepted connection from pid 4356, user nixbot2267gitlab # [ 422.161643] nix-daemon[3694]: accepted connection from pid 4364, user nixbot2268gitlab # [ 422.162553] gitaly[910]: time="2026-08-15T23:48:28.675Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BSMGQM82TAMH5T2VBMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:58.574" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:28.675" grpc.time_ms=0.471 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2269gitlab # [ 422.174967] gitaly[910]: time="2026-08-15T23:48:28.698Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:28.697" grpc.time_ms=0.419 pid=910 span.kind=server system=grpc2270gitlab # [ 422.184544] nixbot[3472]: {"ts": "2026-08-15T23:48:29.046Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-0609b2d3ab4f-4", "argv0": "bwrap"}2271gitlab # [ 422.186855] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.880Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","957de2ef61fba921c833c8be"],"class":"WebHooks::LogExecutionWorker","jid":"369faeca4df50ba5b0c3f78f","created_at":"2026-08-15T23:48:27.697Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-8cfeb98a01bb4d36","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a5935cc0e4dd278db141932fa3dad7cc365233bf091fbffb456c676dad767717","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:27.703Z","job_size_bytes":2592,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-369faeca4df50ba5b0c3f78f: start","job_status":"start","queue_duration_s":1.176644,"scheduling_latency_s":1.176669}2272gitlab # [ 422.203437] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.905Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","957de2ef61fba921c833c8be"],"class":"WebHooks::LogExecutionWorker","jid":"369faeca4df50ba5b0c3f78f","created_at":"2026-08-15T23:48:27.697Z","trace_propagation_headers":{"sentry-trace":"0a6b965024bc49259b96f64b514826ba-8cfeb98a01bb4d36","baggage":"sentry-trace_id=0a6b965024bc49259b96f64b514826ba,sentry-release=Unknown"},"correlation_id":"01M03X4K0BTBVHBQ1EE27BBA9A","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a5935cc0e4dd278db141932fa3dad7cc365233bf091fbffb456c676dad767717","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:27.703Z","job_size_bytes":2592,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-369faeca4df50ba5b0c3f78f: done: 0.025883 sec","job_status":"done","queue_duration_s":1.176644,"scheduling_latency_s":1.176669,"redis_calls":7,"redis_duration_s":0.001669,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025883,"completed_at":"2026-08-15T23:48:28.905Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab # [ 422.245846] gitaly[910]: time="2026-08-15T23:48:28.708Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7A8H0KASNBY69YGKQRG7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:28.706" grpc.time_ms=2.355 pid=910 span.kind=server system=grpc2274gitlab # [ 422.255854] gitaly[910]: time="2026-08-15T23:48:28.726Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:28.726" grpc.time_ms=0.356 pid=910 span.kind=server system=grpc2275gitlab # [ 422.266038] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.907Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"7daba3e93b0276d2876f97d0","created_at":"2026-08-15T23:48:28.441Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-3f96dbd0c5d747bb","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.450Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-7daba3e93b0276d2876f97d0: start","job_status":"start","queue_duration_s":0.457247,"scheduling_latency_s":0.45727}2276gitlab # [ 422.282919] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.998Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"7daba3e93b0276d2876f97d0","created_at":"2026-08-15T23:48:28.441Z","trace_propagation_headers":{"sentry-trace":"58239bdf2b2d49aa9f7722fef37e607f-3f96dbd0c5d747bb","baggage":"sentry-trace_id=58239bdf2b2d49aa9f7722fef37e607f,sentry-release=Unknown"},"correlation_id":"01M03X4CSH7EDVT5CWK6YVRVDM","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.450Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-7daba3e93b0276d2876f97d0: done: 0.091027 sec","job_status":"done","queue_duration_s":0.457247,"scheduling_latency_s":0.45727,"redis_calls":11,"redis_duration_s":0.002595,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002404,"duration_s":0.091027,"completed_at":"2026-08-15T23:48:28.998Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 422.327479] gitaly[910]: time="2026-08-15T23:48:28.733Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS diskcache=7bc59ea2-d2d5-4a29-9ef8-5cda202937df grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:48:38.083" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:28.644" pid=910 ref=refs/keep-around/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 remote_ip="2001:db8:1::1" revision=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 span.kind=server system=grpc username=root2278gitlab # [ 422.338879] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:28.999Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fc14a010908a0327ae8dd834","created_at":"2026-08-15T23:48:28.658Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.660Z","job_size_bytes":23,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fc14a010908a0327ae8dd834: start","job_status":"start","queue_duration_s":0.338699,"scheduling_latency_s":0.338718}2279gitlab # [ 422.356547] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.039Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fc14a010908a0327ae8dd834","created_at":"2026-08-15T23:48:28.658Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.660Z","job_size_bytes":23,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fc14a010908a0327ae8dd834: done: 0.040269 sec","job_status":"done","queue_duration_s":0.338699,"scheduling_latency_s":0.338718,"redis_calls":7,"redis_duration_s":0.001052,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040269,"completed_at":"2026-08-15T23:48:29.039Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006204,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2280gitlab # [ 422.400517] gitaly[910]: time="2026-08-15T23:48:28.734Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5111 command.oublock=8 command.real_time_ms=83 command.spawn_token_fork_ms=5 command.system_time_ms=35 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T23:48:38.083" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T23:48:28.644" grpc.time_ms=88.828 pid=910 ref=refs/keep-around/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 remote_ip="2001:db8:1::1" revision=0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 span.kind=server system=grpc username=root2281gitlab # [ 422.415642] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.041Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"429c12b3d5c58c2b615cf122","created_at":"2026-08-15T23:48:28.747Z","trace_propagation_headers":{"sentry-trace":"86d92af2c86847ae9f7afd9f319426b4-15ae7d1577f84997","baggage":"sentry-trace_id=86d92af2c86847ae9f7afd9f319426b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7BGMYK5CTPEZX23REGNS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.752Z","job_size_bytes":65,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-429c12b3d5c58c2b615cf122: start","job_status":"start","queue_duration_s":0.288926,"scheduling_latency_s":0.288945}2282gitlab # [ 422.432499] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.073Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"429c12b3d5c58c2b615cf122","created_at":"2026-08-15T23:48:28.747Z","trace_propagation_headers":{"sentry-trace":"86d92af2c86847ae9f7afd9f319426b4-15ae7d1577f84997","baggage":"sentry-trace_id=86d92af2c86847ae9f7afd9f319426b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7BGMYK5CTPEZX23REGNS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.752Z","job_size_bytes":65,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-429c12b3d5c58c2b615cf122: done: 0.032202 sec","job_status":"done","queue_duration_s":0.288926,"scheduling_latency_s":0.288945,"redis_calls":7,"redis_duration_s":0.001448,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000396,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032202,"completed_at":"2026-08-15T23:48:29.073Z","load_balancing_strategy":"primary","db_duration_s":0.003904,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2283gitlab # [ 422.476206] gitaly[910]: time="2026-08-15T23:48:28.738Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:58.737" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:28.738" grpc.time_ms=0.225 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2284gitlab # [ 422.489093] gitaly[910]: time="2026-08-15T23:48:28.739Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7A8H0KASNBY69YGKQRG7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:28.739" grpc.time_ms=0.323 pid=910 span.kind=server system=grpc2285gitlab # [ 422.498944] nix-daemon[3694]: accepted connection from pid 4375, user nixbot2286gitlab # [ 422.499908] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.075Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"be0919be8c475b2c7c0758d7","created_at":"2026-08-15T23:48:28.753Z","trace_propagation_headers":{"sentry-trace":"86d92af2c86847ae9f7afd9f319426b4-15ae7d1577f84997","baggage":"sentry-trace_id=86d92af2c86847ae9f7afd9f319426b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7BGMYK5CTPEZX23REGNS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.757Z","job_size_bytes":65,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-be0919be8c475b2c7c0758d7: start","job_status":"start","queue_duration_s":0.318232,"scheduling_latency_s":0.318259}2287gitlab # [ 422.517764] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.142Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"be0919be8c475b2c7c0758d7","created_at":"2026-08-15T23:48:28.753Z","trace_propagation_headers":{"sentry-trace":"86d92af2c86847ae9f7afd9f319426b4-15ae7d1577f84997","baggage":"sentry-trace_id=86d92af2c86847ae9f7afd9f319426b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7BGMYK5CTPEZX23REGNS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.757Z","job_size_bytes":65,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-be0919be8c475b2c7c0758d7: done: 0.067612 sec","job_status":"done","queue_duration_s":0.318232,"scheduling_latency_s":0.318259,"redis_calls":10,"redis_duration_s":0.002163,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067612,"completed_at":"2026-08-15T23:48:29.142Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 422.563966] gitaly[910]: time="2026-08-15T23:48:28.764Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7A8H0KASNBY69YGKQRG7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:28.763" grpc.time_ms=0.441 pid=910 span.kind=server system=grpc2289gitlab # [ 422.574135] gitaly[910]: time="2026-08-15T23:48:28.771Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7A8H0KASNBY69YGKQRG7 diskcache=486cc14e-7117-4b61-95d5-97f44990e11a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:48:58.666" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:28.667" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 422.584309] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.145Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0f19d966cc16e248cd79a699","created_at":"2026-08-15T23:48:28.777Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.780Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0f19d966cc16e248cd79a699: start","job_status":"start","queue_duration_s":0.36499,"scheduling_latency_s":0.365017}2291gitlab # [ 422.600924] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.204Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0f19d966cc16e248cd79a699","created_at":"2026-08-15T23:48:28.777Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.780Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0f19d966cc16e248cd79a699: done: 0.059235 sec","job_status":"done","queue_duration_s":0.36499,"scheduling_latency_s":0.365017,"redis_calls":7,"redis_duration_s":0.00352,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000785,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059235,"completed_at":"2026-08-15T23:48:29.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2292gitlab # [ 422.646727] nix-daemon[3694]: accepted connection from pid 4385, user nixbot2293gitlab # [ 422.647711] nix-daemon[3694]: accepted connection from pid 4375, user nixbot2294gitlab # [ 422.648738] gitaly[910]: time="2026-08-15T23:48:28.771Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=91 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7023 command.oublock=0 command.real_time_ms=100 command.spawn_token_fork_ms=0 command.system_time_ms=60 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7A8H0KASNBY69YGKQRG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:48:58.666" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:28.667" grpc.time_ms=104.388 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2295gitlab # [ 422.662297] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.207Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b9ed9b5def3d8b8f07d54650","created_at":"2026-08-15T23:48:28.788Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.790Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b9ed9b5def3d8b8f07d54650: start","job_status":"start","queue_duration_s":0.417025,"scheduling_latency_s":0.41706}2296gitlab # [ 422.678198] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.256Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"b9ed9b5def3d8b8f07d54650","created_at":"2026-08-15T23:48:28.788Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.790Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-b9ed9b5def3d8b8f07d54650: done: 0.048737 sec","job_status":"done","queue_duration_s":0.417025,"scheduling_latency_s":0.41706,"redis_calls":7,"redis_duration_s":0.0019320000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048737,"completed_at":"2026-08-15T23:48:29.256Z","load_balancing_strategy":"primary","db_duration_s":0.00687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2297gitlab # [ 422.721445] gitaly[910]: time="2026-08-15T23:48:28.826Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X7A8H0KASNBY69YGKQRG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:48:58.824" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:28.824" grpc.time_ms=1.521 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2298gitlab # [ 422.734414] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.258Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"54fab1c3a6d98df7532f58a1","created_at":"2026-08-15T23:48:28.798Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.799Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-54fab1c3a6d98df7532f58a1: start","job_status":"start","queue_duration_s":0.458397,"scheduling_latency_s":0.458424}2299gitlab # [ 422.750403] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.303Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"54fab1c3a6d98df7532f58a1","created_at":"2026-08-15T23:48:28.798Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.799Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-54fab1c3a6d98df7532f58a1: done: 0.045595 sec","job_status":"done","queue_duration_s":0.458397,"scheduling_latency_s":0.458424,"redis_calls":10,"redis_duration_s":0.003484,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001211,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045595,"completed_at":"2026-08-15T23:48:29.303Z","load_balancing_strategy":"primary","db_duration_s":0.008708,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 422.795322] gitaly[910]: time="2026-08-15T23:48:28.860Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7A8H0KASNBY69YGKQRG7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:58.858" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:28.858" grpc.time_ms=1.367 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2301gitlab # [ 422.808666] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.305Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9763e3b508b23a7a88a27261","created_at":"2026-08-15T23:48:28.800Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.802Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9763e3b508b23a7a88a27261: start","job_status":"start","queue_duration_s":0.503712,"scheduling_latency_s":0.503736}2302gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses2303gitlab # [ 422.825568] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.341Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9763e3b508b23a7a88a27261","created_at":"2026-08-15T23:48:28.800Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.802Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9763e3b508b23a7a88a27261: done: 0.03584 sec","job_status":"done","queue_duration_s":0.503712,"scheduling_latency_s":0.503736,"redis_calls":7,"redis_duration_s":0.0037129999999999997,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000633,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03584,"completed_at":"2026-08-15T23:48:29.341Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2304gitlab # [ 422.866138] gitaly[910]: time="2026-08-15T23:48:29.592Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:48:59.590" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:29.591" grpc.time_ms=1.501 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 422.878043] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.343Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"56cd6e08c6919b4982b9794c","created_at":"2026-08-15T23:48:28.802Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.804Z","job_size_bytes":19,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-56cd6e08c6919b4982b9794c: start","job_status":"start","queue_duration_s":0.539339,"scheduling_latency_s":0.539361}2306gitlab # [ 422.894425] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.382Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"56cd6e08c6919b4982b9794c","created_at":"2026-08-15T23:48:28.802Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.804Z","job_size_bytes":19,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-56cd6e08c6919b4982b9794c: done: 0.03858 sec","job_status":"done","queue_duration_s":0.539339,"scheduling_latency_s":0.539361,"redis_calls":8,"redis_duration_s":0.005976,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005491,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03858,"completed_at":"2026-08-15T23:48:29.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2307gitlab # [ 422.937520] gitaly[910]: time="2026-08-15T23:48:29.639Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7BGMYK5CTPEZX23REGNS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:59.637" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:29.638" grpc.time_ms=1.069 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2308gitlab # [ 422.949976] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.383Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a208e7bb2042f04597e0779f","created_at":"2026-08-15T23:48:28.805Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.807Z","job_size_bytes":66,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a208e7bb2042f04597e0779f: start","job_status":"start","queue_duration_s":0.576686,"scheduling_latency_s":0.576706}2309gitlab # [ 422.967485] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.410Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a208e7bb2042f04597e0779f","created_at":"2026-08-15T23:48:28.805Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.807Z","job_size_bytes":66,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a208e7bb2042f04597e0779f: done: 0.026979 sec","job_status":"done","queue_duration_s":0.576686,"scheduling_latency_s":0.576706,"redis_calls":7,"redis_duration_s":0.001091,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026979,"completed_at":"2026-08-15T23:48:29.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2310gitlab # [ 423.012639] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.412Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8598449cbd1fa19ec58c7da6","created_at":"2026-08-15T23:48:28.807Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.809Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8598449cbd1fa19ec58c7da6: start","job_status":"start","queue_duration_s":0.602858,"scheduling_latency_s":0.602879}2311gitlab # [ 423.029138] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.437Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"8598449cbd1fa19ec58c7da6","created_at":"2026-08-15T23:48:28.807Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.809Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-8598449cbd1fa19ec58c7da6: done: 0.025273 sec","job_status":"done","queue_duration_s":0.602858,"scheduling_latency_s":0.602879,"redis_calls":7,"redis_duration_s":0.000926,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025273,"completed_at":"2026-08-15T23:48:29.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses, in 0.24 seconds)2313gitlab # [ 423.074373] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.438Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"11c627802c47d75e5ce09551","created_at":"2026-08-15T23:48:28.809Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.811Z","job_size_bytes":6,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-11c627802c47d75e5ce09551: start","job_status":"start","queue_duration_s":0.627241,"scheduling_latency_s":0.62726}2314gitlab # [ 423.090131] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.452Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"11c627802c47d75e5ce09551","created_at":"2026-08-15T23:48:28.809Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.811Z","job_size_bytes":6,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-11c627802c47d75e5ce09551: done: 0.013786 sec","job_status":"done","queue_duration_s":0.627241,"scheduling_latency_s":0.62726,"redis_calls":7,"redis_duration_s":0.0009519999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013786,"completed_at":"2026-08-15T23:48:29.452Z","load_balancing_strategy":"primary","db_duration_s":0.000316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 423.132648] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1452316gitlab # [ 423.135530] gitaly[910]: time="2026-08-15T23:48:29.906Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7CZFR7PM8HP9PFGKE9S7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:48:59.803" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:29.904" grpc.time_ms=1.169 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2317gitlab # [ 423.148374] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.453Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cde78366f672080004f083ae","created_at":"2026-08-15T23:48:28.811Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.813Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cde78366f672080004f083ae: start","job_status":"start","queue_duration_s":0.639556,"scheduling_latency_s":0.639573}2318gitlab # [ 423.163721] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.482Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cde78366f672080004f083ae","created_at":"2026-08-15T23:48:28.811Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.813Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cde78366f672080004f083ae: done: 0.029066 sec","job_status":"done","queue_duration_s":0.639556,"scheduling_latency_s":0.639573,"redis_calls":7,"redis_duration_s":0.0034649999999999998,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029066,"completed_at":"2026-08-15T23:48:29.482Z","load_balancing_strategy":"primary","db_duration_s":0.004379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 423.206860] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.483Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"08f0986908dfd250e5b692f7","created_at":"2026-08-15T23:48:28.820Z","trace_propagation_headers":{"sentry-trace":"86d92af2c86847ae9f7afd9f319426b4-15ae7d1577f84997","baggage":"sentry-trace_id=86d92af2c86847ae9f7afd9f319426b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7BGMYK5CTPEZX23REGNS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.823Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-08f0986908dfd250e5b692f7: start","job_status":"start","queue_duration_s":0.660155,"scheduling_latency_s":0.660173}2320gitlab # [ 423.222978] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.652Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"08f0986908dfd250e5b692f7","created_at":"2026-08-15T23:48:28.820Z","trace_propagation_headers":{"sentry-trace":"86d92af2c86847ae9f7afd9f319426b4-15ae7d1577f84997","baggage":"sentry-trace_id=86d92af2c86847ae9f7afd9f319426b4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7BGMYK5CTPEZX23REGNS","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.823Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-08f0986908dfd250e5b692f7: done: 0.168771 sec","job_status":"done","queue_duration_s":0.660155,"scheduling_latency_s":0.660173,"gitaly_calls":2,"gitaly_duration_s":0.00876,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006634,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000802,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001226,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000367,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001801,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00018,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000616,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00084,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":28,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109474,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13641156,"duration_s":0.168771,"completed_at":"2026-08-15T23:48:29.652Z","load_balancing_strategy":"primary","db_duration_s":0.051554,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2321gitlab # [ 423.274885] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.653Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3ec291b46181cb4a4cbe6a85","created_at":"2026-08-15T23:48:28.870Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.872Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3ec291b46181cb4a4cbe6a85: start","job_status":"start","queue_duration_s":0.78191,"scheduling_latency_s":0.781928}2322gitlab # [ 423.290891] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.684Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3ec291b46181cb4a4cbe6a85","created_at":"2026-08-15T23:48:28.870Z","trace_propagation_headers":{"sentry-trace":"3773fba5d17441a8969a35268c927531-9a30b8df50614ece","baggage":"sentry-trace_id=3773fba5d17441a8969a35268c927531,sentry-release=Unknown"},"correlation_id":"01M03X7A8H0KASNBY69YGKQRG7","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:28.872Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3ec291b46181cb4a4cbe6a85: done: 0.030711 sec","job_status":"done","queue_duration_s":0.78191,"scheduling_latency_s":0.781928,"redis_calls":8,"redis_duration_s":0.0021,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001617,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030711,"completed_at":"2026-08-15T23:48:29.684Z","load_balancing_strategy":"primary","db_duration_s":0.006639,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2323gitlab # [ 423.333212] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.686Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"fe88ab5b6312fa1ddcd71b08","created_at":"2026-08-15T23:48:29.572Z","trace_propagation_headers":{"sentry-trace":"86d92af2c86847ae9f7afd9f319426b4-3699d42074504c05","baggage":"sentry-trace_id=86d92af2c86847ae9f7afd9f319426b4,sentry-release=Unknown"},"correlation_id":"01M03X7BGMYK5CTPEZX23REGNS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:29.574Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-fe88ab5b6312fa1ddcd71b08: start","job_status":"start","queue_duration_s":0.112021,"scheduling_latency_s":0.112038}2324gitlab # [ 423.349571] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:29.723Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"fe88ab5b6312fa1ddcd71b08","created_at":"2026-08-15T23:48:29.572Z","trace_propagation_headers":{"sentry-trace":"86d92af2c86847ae9f7afd9f319426b4-3699d42074504c05","baggage":"sentry-trace_id=86d92af2c86847ae9f7afd9f319426b4,sentry-release=Unknown"},"correlation_id":"01M03X7BGMYK5CTPEZX23REGNS","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:29.574Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-fe88ab5b6312fa1ddcd71b08: done: 0.037368 sec","job_status":"done","queue_duration_s":0.112021,"scheduling_latency_s":0.112038,"redis_calls":7,"redis_duration_s":0.001925,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037368,"completed_at":"2026-08-15T23:48:29.723Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses2326gitlab # [ 424.245375] gitaly[910]: time="2026-08-15T23:48:31.132Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7E5KS0MKX148CP2VD0P7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:49:01.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:31.130" grpc.time_ms=1.228 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2327gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses, in 0.23 seconds)2328gitlab # [ 424.300653] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1592329gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses2330gitlab # [ 425.459983] gitaly[910]: time="2026-08-15T23:48:32.346Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7FBQ02KGWPXHWRG9APDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:49:02.244" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:32.345" grpc.time_ms=1.158 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2331gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses, in 0.21 seconds)2332gitlab # [ 425.515117] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1542333gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses2334gitlab # [ 426.678542] gitaly[910]: time="2026-08-15T23:48:33.565Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7GHPHTMZ9BR35MPN3PR1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:49:03.462" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:33.563" grpc.time_ms=1.317 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses, in 0.21 seconds)2336gitlab # [ 426.728907] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1522337gitlab # [ 427.306586] gitaly[910]: time="2026-08-15T23:48:34.194Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:49:04.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:34.192" grpc.time_ms=1.29 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2338gitlab # [ 427.404297] gitaly[910]: time="2026-08-15T23:48:34.291Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:44.163" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:34.273" grpc.time_ms=17.747 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2339gitlab # [ 427.491988] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:34.378Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c711af17388c465b23890248","created_at":"2026-08-15T23:48:34.362Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-32f0d308dcd64e26","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.374Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c711af17388c465b23890248: start","job_status":"start","queue_duration_s":0.003797,"scheduling_latency_s":0.003873}2340gitlab # [ 427.538351] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3352341gitlab # [ 427.544995] nixbot[3472]: {"ts": "2026-08-15T23:48:34.412Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 \"HTTP/1.1 201 Created\""}2342gitlab # [ 427.654288] gitaly[910]: time="2026-08-15T23:48:34.541Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7HFNAPVRGTAS9616XN04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:49:04.540" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:34.540" grpc.time_ms=0.945 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2343gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses2344gitlab # [ 427.736323] gitaly[910]: time="2026-08-15T23:48:34.622Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M03X7HFNAPVRGTAS9616XN04 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:44.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:34.608" grpc.time_ms=14.147 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2345gitlab # [ 427.768731] gitaly[910]: time="2026-08-15T23:48:34.633Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:34.632" grpc.time_ms=0.574 pid=910 span.kind=server system=grpc2346gitlab # [ 427.799832] gitaly[910]: time="2026-08-15T23:48:34.687Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:34.687" grpc.time_ms=0.531 pid=910 span.kind=server system=grpc2347gitlab # [ 427.846039] gitaly[910]: time="2026-08-15T23:48:34.733Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:34.732" grpc.time_ms=1.022 pid=910 span.kind=server system=grpc2348gitlab # [ 427.872964] gitaly[910]: time="2026-08-15T23:48:34.741Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:49:04.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:34.569" operations="[repack_refs]" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2349gitlab # [ 427.894074] gitaly[910]: time="2026-08-15T23:48:34.744Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:49:04.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:34.569" pid=910 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-15 23:46:49.55162398 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2350gitlab # [ 427.917445] gitaly[910]: time="2026-08-15T23:48:34.745Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 diskcache=7e3bdc13-2256-444b-b85a-c12a7f39841c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:49:04.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:34.569" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2351gitlab # [ 427.932973] gitaly[910]: time="2026-08-15T23:48:34.745Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=162 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7192 command.oublock=0 command.real_time_ms=168 command.spawn_token_fork_ms=2 command.system_time_ms=91 command.user_time_ms=71 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:49:04.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:34.569" grpc.time_ms=175.944 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2352gitlab # [ 427.950745] gitaly[910]: time="2026-08-15T23:48:34.780Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:49:04.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:34.569" pid=910 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2353gitlab # [ 427.966607] gitaly[910]: time="2026-08-15T23:48:34.780Z" level=info msg="optimized repository" clean_stale_data_time=35.12094ms clean_work_trees_time="207.12µs" commit_graph_time=960ns correlation_id=01M03X7H4T6N8K3XYASBNZM170 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="2.52µs" pid=910 prune_time=340ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.9µs" storage_name=default system=housekeeping total_time=35.36592ms2354gitlab # [ 427.973470] nixbot[3472]: {"ts": "2026-08-15T23:48:34.838Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 \"HTTP/1.1 201 Created\""}2355gitlab # [ 427.977135] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4142356gitlab # [ 427.979993] gitaly[910]: time="2026-08-15T23:48:34.780Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:49:04.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:34.569" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2357gitlab # [ 427.990766] gitaly[910]: time="2026-08-15T23:48:34.825Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7HQZWNPGY280NGX0R67Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:49:04.822" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:34.823" grpc.time_ms=2.139 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2358gitlab # [ 428.005437] gitaly[910]: time="2026-08-15T23:48:34.869Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T23:49:04.868" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:34.868" grpc.time_ms=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2359gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses, in 0.30 seconds)2360gitlab # [ 428.018858] gitaly[910]: time="2026-08-15T23:48:34.906Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:49:04.005" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:34.906" grpc.time_ms=0.454 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2361gitlab # [ 428.031375] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses HTTP/1.1" 200 1307 "" "curl/8.21.0" 2232362gitlab # [ 428.033942] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:34.918Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"51871176a452331883e4314d","created_at":"2026-08-15T23:48:34.916Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"c711af17388c465b23890248","job_size_bytes":3,"pid":3375,"job_status":"deduplicated","message":"PipelineProcessWorker JID-51871176a452331883e4314d: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2363gitlab # [ 428.049340] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:34.920Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c711af17388c465b23890248","created_at":"2026-08-15T23:48:34.362Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-32f0d308dcd64e26","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.374Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3375,"job_status":"rescheduled","message":"PipelineProcessWorker JID-c711af17388c465b23890248: rescheduled"}2364gitlab # [ 428.064140] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:34.928Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c711af17388c465b23890248","created_at":"2026-08-15T23:48:34.362Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-32f0d308dcd64e26","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.374Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c711af17388c465b23890248: done: 0.550986 sec","job_status":"done","queue_duration_s":0.003797,"scheduling_latency_s":0.003873,"gitaly_calls":3,"gitaly_duration_s":0.188556,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.039884,"redis_read_bytes":239,"redis_write_bytes":21783,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002256,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002531,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.009032,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.018879,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000548,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001025,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003357,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.015,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.019,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.035,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.273149,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.4648553,"duration_s":0.550986,"completed_at":"2026-08-15T23:48:34.928Z","load_balancing_strategy":"primary","db_duration_s":0.059891,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2365gitlab # [ 428.116744] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:34.930Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"40341493e9d1563e032b83a2","created_at":"2026-08-15T23:48:34.547Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.554Z","job_size_bytes":23,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-40341493e9d1563e032b83a2: start","job_status":"start","queue_duration_s":0.375928,"scheduling_latency_s":0.375953}2366gitlab # [ 428.133159] gitaly[910]: time="2026-08-15T23:48:34.935Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7HX8G3RJG74Z0EX1A83T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:49:04.833" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:34.934" grpc.time_ms=0.674 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2367gitlab # [ 428.145674] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:34.975Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"40341493e9d1563e032b83a2","created_at":"2026-08-15T23:48:34.547Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.554Z","job_size_bytes":23,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-40341493e9d1563e032b83a2: done: 0.04515 sec","job_status":"done","queue_duration_s":0.375928,"scheduling_latency_s":0.375953,"redis_calls":7,"redis_duration_s":0.0033109999999999997,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002721,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04515,"completed_at":"2026-08-15T23:48:34.975Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0068,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2368gitlab # [ 428.188252] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:34.977Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7117e6fb4845981e0eabef41","created_at":"2026-08-15T23:48:34.758Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.765Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7117e6fb4845981e0eabef41: start","job_status":"start","queue_duration_s":0.211639,"scheduling_latency_s":0.21166}2369gitlab # [ 428.204913] gitaly[910]: time="2026-08-15T23:48:34.992Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M03X7HX8G3RJG74Z0EX1A83T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T23:48:44.251" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:34.982" grpc.time_ms=10.331 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2370gitlab # [ 428.218163] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2032371gitlab # [ 428.220598] nixbot[3472]: {"ts": "2026-08-15T23:48:35.055Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1 \"HTTP/1.1 201 Created\""}2372gitlab # [ 428.223217] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.007Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7117e6fb4845981e0eabef41","created_at":"2026-08-15T23:48:34.758Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.765Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7117e6fb4845981e0eabef41: done: 0.030694 sec","job_status":"done","queue_duration_s":0.211639,"scheduling_latency_s":0.21166,"redis_calls":7,"redis_duration_s":0.002155,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001294,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000861,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030694,"completed_at":"2026-08-15T23:48:35.007Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2373gitlab # [ 428.266640] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.009Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a3f7494282a7175e10ed9810","created_at":"2026-08-15T23:48:34.774Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.778Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a3f7494282a7175e10ed9810: start","job_status":"start","queue_duration_s":0.23093,"scheduling_latency_s":0.23095}2374gitlab # [ 428.282920] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.039Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"a3f7494282a7175e10ed9810","created_at":"2026-08-15T23:48:34.774Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.778Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-a3f7494282a7175e10ed9810: done: 0.030654 sec","job_status":"done","queue_duration_s":0.23093,"scheduling_latency_s":0.23095,"redis_calls":7,"redis_duration_s":0.001648,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001156,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030654,"completed_at":"2026-08-15T23:48:35.039Z","load_balancing_strategy":"primary","db_duration_s":0.004028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2375gitlab # [ 428.326480] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.041Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e61ed5dcfdafc190dcd99f7a","created_at":"2026-08-15T23:48:34.795Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.799Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e61ed5dcfdafc190dcd99f7a: start","job_status":"start","queue_duration_s":0.242147,"scheduling_latency_s":0.242165}2376gitlab # [ 428.342400] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.075Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e61ed5dcfdafc190dcd99f7a","created_at":"2026-08-15T23:48:34.795Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.799Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e61ed5dcfdafc190dcd99f7a: done: 0.033841 sec","job_status":"done","queue_duration_s":0.242147,"scheduling_latency_s":0.242165,"redis_calls":10,"redis_duration_s":0.005581,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000678,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003774,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033841,"completed_at":"2026-08-15T23:48:35.075Z","load_balancing_strategy":"primary","db_duration_s":0.003688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2377gitlab # [ 428.385902] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.079Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"bd633e47eeeceba8938bb198","created_at":"2026-08-15T23:48:34.800Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.804Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-bd633e47eeeceba8938bb198: start","job_status":"start","queue_duration_s":0.274942,"scheduling_latency_s":0.274963}2378gitlab # [ 428.402910] nix-daemon[3694]: accepted connection from pid 4473, user nixbot2379gitlab # [ 428.403856] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.108Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"bd633e47eeeceba8938bb198","created_at":"2026-08-15T23:48:34.800Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.804Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-bd633e47eeeceba8938bb198: done: 0.029153 sec","job_status":"done","queue_duration_s":0.274942,"scheduling_latency_s":0.274963,"redis_calls":7,"redis_duration_s":0.003356,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029153,"completed_at":"2026-08-15T23:48:35.108Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2380gitlab # [ 428.446631] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.109Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8a9e9237bcf7fcba49b987fc","created_at":"2026-08-15T23:48:34.805Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.812Z","job_size_bytes":19,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8a9e9237bcf7fcba49b987fc: start","job_status":"start","queue_duration_s":0.297399,"scheduling_latency_s":0.297417}2381gitlab # [ 428.462976] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.136Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8a9e9237bcf7fcba49b987fc","created_at":"2026-08-15T23:48:34.805Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.812Z","job_size_bytes":19,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8a9e9237bcf7fcba49b987fc: done: 0.026416 sec","job_status":"done","queue_duration_s":0.297399,"scheduling_latency_s":0.297417,"redis_calls":8,"redis_duration_s":0.001292,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026416,"completed_at":"2026-08-15T23:48:35.136Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 428.505409] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.137Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7b37c1995f73253843ecb226","created_at":"2026-08-15T23:48:34.814Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.818Z","job_size_bytes":66,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7b37c1995f73253843ecb226: start","job_status":"start","queue_duration_s":0.319311,"scheduling_latency_s":0.319329}2383gitlab # [ 428.523900] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.160Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7b37c1995f73253843ecb226","created_at":"2026-08-15T23:48:34.814Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.818Z","job_size_bytes":66,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7b37c1995f73253843ecb226: done: 0.022586 sec","job_status":"done","queue_duration_s":0.319311,"scheduling_latency_s":0.319329,"redis_calls":7,"redis_duration_s":0.001147,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022586,"completed_at":"2026-08-15T23:48:35.159Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 428.567879] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.161Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7c636db9854b7fb32b81d43b","created_at":"2026-08-15T23:48:34.821Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.825Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7c636db9854b7fb32b81d43b: start","job_status":"start","queue_duration_s":0.335782,"scheduling_latency_s":0.3358}2385gitlab # [ 428.584657] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.195Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7c636db9854b7fb32b81d43b","created_at":"2026-08-15T23:48:34.821Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.825Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7c636db9854b7fb32b81d43b: done: 0.033759 sec","job_status":"done","queue_duration_s":0.335782,"scheduling_latency_s":0.3358,"redis_calls":7,"redis_duration_s":0.0010220000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033759,"completed_at":"2026-08-15T23:48:35.195Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 428.627716] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.196Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"0ea82921fcfd58e3e3bdc98c","created_at":"2026-08-15T23:48:34.834Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.841Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0ea82921fcfd58e3e3bdc98c: start","job_status":"start","queue_duration_s":0.354576,"scheduling_latency_s":0.354594}2387gitlab # [ 428.644264] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1222388gitlab # [ 428.646394] gitaly[910]: time="2026-08-15T23:48:35.430Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M03X7JBCM2MR2SAQ3ZQA92J8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:35.416" grpc.time_ms=13.636 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2389gitlab # [ 428.659980] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.222Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"0ea82921fcfd58e3e3bdc98c","created_at":"2026-08-15T23:48:34.834Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.841Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0ea82921fcfd58e3e3bdc98c: done: 0.026181 sec","job_status":"done","queue_duration_s":0.354576,"scheduling_latency_s":0.354594,"redis_calls":7,"redis_duration_s":0.0009480000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026181,"completed_at":"2026-08-15T23:48:35.222Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 428.703224] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.223Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e08bb6bbb0f48c6db1c3706a","created_at":"2026-08-15T23:48:34.842Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.846Z","job_size_bytes":6,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e08bb6bbb0f48c6db1c3706a: start","job_status":"start","queue_duration_s":0.376762,"scheduling_latency_s":0.376779}2391gitlab # [ 428.720794] gitaly[910]: time="2026-08-15T23:48:35.536Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7JF9MAQ5FVQGF6HD580P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:35.522" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2392gitlab # [ 428.730755] gitlab-workhorse[820]: time="2026-08-15T23:48:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672393gitlab # [ 428.732666] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1042394gitlab # [ 428.734566] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.238Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e08bb6bbb0f48c6db1c3706a","created_at":"2026-08-15T23:48:34.842Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.846Z","job_size_bytes":6,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e08bb6bbb0f48c6db1c3706a: done: 0.015064 sec","job_status":"done","queue_duration_s":0.376762,"scheduling_latency_s":0.376779,"redis_calls":7,"redis_duration_s":0.000993,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015064,"completed_at":"2026-08-15T23:48:35.238Z","load_balancing_strategy":"primary","db_duration_s":0.0003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2395gitlab # [ 428.776579] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"7d84807fd506e0e40af9f081","created_at":"2026-08-15T23:48:34.848Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.851Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7d84807fd506e0e40af9f081: start","job_status":"start","queue_duration_s":0.388668,"scheduling_latency_s":0.388686}2396gitlab # [ 428.792242] gitaly[910]: time="2026-08-15T23:48:35.536Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7JF9MAQ5FVQGF6HD580P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:35.522" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2397gitlab # [ 428.806138] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.372Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"7d84807fd506e0e40af9f081","created_at":"2026-08-15T23:48:34.848Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.851Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7d84807fd506e0e40af9f081: done: 0.13307 sec","job_status":"done","queue_duration_s":0.388668,"scheduling_latency_s":0.388686,"redis_calls":7,"redis_duration_s":0.003849,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001774,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.049,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.13307,"completed_at":"2026-08-15T23:48:35.372Z","load_balancing_strategy":"primary","db_duration_s":0.129043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2398gitlab # [ 428.848582] sidekiq-cluster[3375]: {"severity":"INFO","time":"2026-08-15T23:48:35.382Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"bce0a3dfeaeac8758faba2ce","created_at":"2026-08-15T23:48:34.921Z","trace_propagation_headers":{"sentry-trace":"3666efda33b3406e99d2f82eecbb73ee-a523aec7c4c14a76","baggage":"sentry-trace_id=3666efda33b3406e99d2f82eecbb73ee,sentry-release=Unknown"},"correlation_id":"01M03X7H4T6N8K3XYASBNZM170","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T23:48:34.922Z","job_size_bytes":3,"pid":3375,"sidekiq_tid":"m8nn","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bce0a3dfeaeac8758faba2ce: start","job_status":"start","queue_duration_s":0.45948,"scheduling_latency_s":0.459499}2399gitlab # [ 428.864403] nix-daemon[3694]: accepted connection from pid 4500, user nixbot2400gitlab # [ 428.865448] gitaly[910]: time="2026-08-15T23:48:35.539Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7JF9MAQ5FVQGF6HD580P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T23:48:35.522" grpc.time_ms=15.211 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2401gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses2402gitlab # [ 429.038299] gitaly[910]: time="2026-08-15T23:48:35.926Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:35.923" grpc.time_ms=2.232 pid=910 span.kind=server system=grpc2403gitlab # [ 429.096256] gitaly[910]: time="2026-08-15T23:48:35.984Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:35.982" grpc.time_ms=1.598 pid=910 span.kind=server system=grpc2404gitlab # [ 429.142840] gitaly[910]: time="2026-08-15T23:48:36.030Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T23:48:36.029" grpc.time_ms=0.668 pid=910 span.kind=server system=grpc2405gitlab # [ 429.165225] gitaly[910]: time="2026-08-15T23:48:36.053Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 diskcache=d8b9aac2-5e08-4abb-9ffa-c52be56945d2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:49:05.859" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:35.860" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2406gitlab # [ 429.178655] gitaly[910]: time="2026-08-15T23:48:36.053Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=182 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7059 command.oublock=0 command.real_time_ms=186 command.spawn_token_fork_ms=1 command.system_time_ms=99 command.user_time_ms=83 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7H4T6N8K3XYASBNZM170 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T23:49:05.859" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T23:48:35.860" grpc.time_ms=193.185 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2407gitlab # [ 429.195125] gitaly[910]: time="2026-08-15T23:48:36.072Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M03X7K0CERGBXE1HN3H7K507 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T23:49:06.070" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T23:48:36.070" grpc.time_ms=1.138 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2408gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses, in 0.21 seconds)2409gitlab # [ 429.235047] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/08/15:23:48:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0609b2d3ab4f236ca72cc86a12579eda4d9f41f1/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 1412410(finished: subtest: eval and build post commit statuses, in 7.58 seconds)2411(finished: run the VM test script, in 502.67 seconds)2412test script finished in 502.71s2413cleanup2414kill QemuMachine (pid 46)2415gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2416(finished: cleanup, in 1.29 seconds)2417additionally exposed symbols:2418 gitlab,2419 vlan1,2420 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2421[]2422[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-15T23:46:56.321Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2423[]2424[]2425[]2426[]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[]2493[]2494[]2495[]2496[]2497[]2498[]2499[]2500[]2501[]2502[]2503[]2504[]2505[]2506[]2507[]2508[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-15T23:48:28.298099Z', 'started_at': None, 'finished_at': None}]2509[]2510[{'id': 5, 'sha': '0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T23:48:28.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2511[{'id': 5, 'sha': '0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T23:48:28.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2512[{'id': 5, 'sha': '0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T23:48:28.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2513[{'id': 5, 'sha': '0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T23:48:28.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2514[{'id': 5, 'sha': '0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-15T23:48:28.811Z', 'started_at': None, 'finished_at': '2026-08-15T23:48:34.342Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-15T23:48:34.688Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2515[{'id': 5, 'sha': '0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-15T23:48:28.811Z', 'started_at': None, 'finished_at': '2026-08-15T23:48:34.342Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '0609b2d3ab4f236ca72cc86a12579eda4d9f41f1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-15T23:48:34.688Z', 'started_at': None, 'finished_at': '2026-08-15T23:48:35.020Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]